Sep 05 04:55:28 devstack cinder-volume[78330]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 05 04:55:28 devstack cinder-volume[78330]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 05 04:55:28 devstack cinder-volume[78330]: we strongly recommend against using it for new projects. Sep 05 04:55:28 devstack cinder-volume[78330]: If you are already using Eventlet, we recommend migrating to a different Sep 05 04:55:28 devstack cinder-volume[78330]: framework. For more detail see Sep 05 04:55:28 devstack cinder-volume[78330]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 05 04:55:28 devstack cinder-volume[78330]: import eventlet # noqa Sep 05 04:55:30 devstack cinder-volume[78330]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=78330) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 04:55:30 devstack cinder-volume[78330]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=78330) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 04:55:30 devstack cinder-volume[78330]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=78330) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 04:55:31 devstack cinder-volume[78330]: INFO dbcounter [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Registered counter for database cinder Sep 05 04:55:31 devstack cinder-volume[78330]: DEBUG oslo_db.sqlalchemy.engines [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78330) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 04:55:32 devstack cinder-volume[78330]: DEBUG dbcounter [-] [78330] Writer thread running {{(pid=78330) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 04:55:32 devstack cinder-volume[78330]: INFO cinder.rpc [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 05 04:55:32 devstack cinder-volume[78330]: INFO cinder.rpc [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 05 04:55:32 devstack cinder-volume[78330]: DEBUG oslo_db.sqlalchemy.engines [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78330) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 04:55:32 devstack cinder-volume[78330]: INFO cinder.volume.manager [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Determined volume DB was empty at startup. Sep 05 04:55:32 devstack cinder-volume[78330]: DEBUG cinder.volume.manager [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=78330) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 05 04:55:32 devstack cinder-volume[78330]: INFO cinder.volume.manager [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 05 04:55:32 devstack cinder-volume[78330]: WARNING stevedore.named [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 05 04:55:32 devstack cinder-volume[78330]: WARNING castellan.key_manager [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 04:55:32 devstack cinder-volume[78330]: WARNING cinder.keymgr.conf_key_mgr [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 04:55:32 devstack cinder-volume[78330]: DEBUG cinder.volume.drivers.lvm [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=78330) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 05 04:55:32 devstack cinder-volume[78330]: DEBUG oslo_concurrency.processutils [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=78330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:32 devstack cinder-volume[78330]: DEBUG oslo_concurrency.processutils [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] CMD "cinder-rtstool verify" returned: 0 in 0.419s {{(pid=78330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_db.sqlalchemy.engines [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78330) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 04:55:33 devstack cinder-volume[78330]: INFO cinder.rpc [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 05 04:55:33 devstack cinder-volume[78330]: INFO cinder.rpc [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 05 04:55:33 devstack cinder-volume[78330]: WARNING stevedore.named [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 05 04:55:33 devstack cinder-volume[78330]: WARNING castellan.key_manager [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 04:55:33 devstack cinder-volume[78330]: INFO cinder.volume.manager [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_db.sqlalchemy.engines [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78330) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 04:55:33 devstack cinder-volume[78330]: INFO oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Starting 1 workers Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Started child 78478 {{(pid=78330) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Full set of CONF: {{(pid=78330) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] ******************************************************************************** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Configuration options gathered from: {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] ================================================================================ {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] allow_availability_zone_fallback = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] allow_compression_on_image_upload = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] allowed_direct_url_schemes = [] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] api_rate_limit = True {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] auth_strategy = keystone {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] az_cache_duration = 3600 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_availability_zone = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_host = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_name = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_stats_polling_interval = 60 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backup_api_class = cinder.backup.api.API {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backup_name_template = backup-%s {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backup_use_same_host = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backup_use_temp_snapshot = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] chap_password = **** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] chap_username = {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cinder_internal_tenant_project_id = c268ecf0b76c40019ddef0e6da15f5d4 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cinder_internal_tenant_user_id = 980201c4fe57468c95df93628f3ca296 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cloned_volume_same_az = True {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cluster = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] compression_format = gzip {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] compute_api_class = cinder.compute.nova.API {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] config_dir = [] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] config_source = [] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] control_exchange = openstack {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78478]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] debug = True {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] default_availability_zone = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] default_group_type = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] default_volume_type = lvmdriver-1 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] disk_geometry = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] driver_client_cert = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] driver_client_cert_key = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] driver_data_namespace = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] driver_ssl_cert_path = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] driver_ssl_cert_verify = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] driver_use_ssl = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] enable_force_upload = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] enable_new_services = True {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] enable_unsupported_driver = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] enabled_backends = ['lvmdriver-1'] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] enforce_multipath_for_image_xfer = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] filter_function = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] glance_api_insecure = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] glance_api_servers = ['http://192.168.122.128/image'] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] glance_api_ssl_compression = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] glance_ca_certificates_file = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] glance_catalog_info = image:glance:publicURL {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] glance_certfile = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] glance_keyfile = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] glance_num_retries = 3 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] glance_request_timeout = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] goodness_function = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] graceful_shutdown_timeout = 5 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] group_api_class = cinder.group.api.API {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] host = devstack {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] image_compress_on_upload = True {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] image_conversion_address_space_limit = 1 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] image_conversion_cpu_limit = 60 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] image_conversion_disable = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] image_upload_use_cinder_backend = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] image_upload_use_internal_tenant = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] image_volume_cache_enabled = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] image_volume_cache_max_count = 0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] image_volume_cache_max_size_gb = 0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] init_host_max_objects_retrieval = 0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] instance_format = [instance: %(uuid)s] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] iscsi_target_flags = {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] iscsi_write_cache = on {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] iser_helper = tgtadm {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] iser_ip_address = 192.168.122.128 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] iser_port = 3260 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] log_color = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] log_config_append = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] log_dir = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] log_file = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] log_options = True {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] log_rotate_interval = 1 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] log_rotate_interval_type = days {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] log_rotation_type = none {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] max_age = 0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] max_logfile_count = 30 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] max_logfile_size_mb = 200 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] max_over_subscription_ratio = 20.0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] message_reap_interval = 86400 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] message_ttl = 2592000 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] migration_create_volume_timeout_secs = 300 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] monkey_patch = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] monkey_patch_modules = [] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] my_ip = 192.168.122.128 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] no_snapshot_gb_quota = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] num_iser_scan_tries = 3 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] num_shell_tries = 3 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] num_volume_device_scan_tries = 3 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] nvmeof_conn_info_version = 1 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] nvmet_ns_id = 10 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] nvmet_port_id = 1 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] osapi_max_limit = 1000 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] osapi_volume_ext_list = [] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] osapi_volume_listen = 0.0.0.0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] osapi_volume_listen_port = 8776 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] osapi_volume_use_ssl = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] osapi_volume_workers = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] per_volume_size_limit = -1 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] periodic_fuzzy_delay = 60 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] periodic_interval = 60 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] project_id_regex = [0-9a-f\-]+ {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] public_endpoint = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] publish_errors = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] quota_backup_gigabytes = 1000 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] quota_backups = 10 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] quota_gigabytes = 1000 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] quota_groups = 10 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] quota_snapshots = 10 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] quota_volumes = 10 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] rate_limit_burst = 0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] rate_limit_except_level = CRITICAL {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] rate_limit_interval = 0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] reinit_driver_count = 3 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] replication_device = **** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] report_discard_supported = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] report_interval = 120 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] reservation_clean_interval = 86400 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] reservation_expire = 86400 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] reserved_image_namespaces = [] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] reserved_percentage = 0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] rpc_response_timeout = 120 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] run_external_periodic_tasks = True {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] scst_target_driver = iscsi {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] scst_target_iqn_name = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] service_down_time = 720 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] shell_completion = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] snapshot_name_template = snapshot-%s {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] snapshot_same_host = True {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] split_loggers = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] state_path = /opt/stack/data/cinder {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] storage_availability_zone = nova {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] storage_protocol = iSCSI {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] syslog_log_facility = LOG_USER {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] target_helper = lioadm {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] target_ip_address = 192.168.122.128 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] target_port = 3260 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] target_protocol = iscsi {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] target_secondary_ip_addresses = [] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] trace_flags = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] transfer_api_class = cinder.transfer.api.API {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] transport_url = **** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] until_refresh = 0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] use_chap_auth = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] use_default_quota_class = True {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] use_journal = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] use_json = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] use_multipath_for_image_xfer = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] use_stderr = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] use_syslog = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] verify_glance_signatures = enabled {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] volume_api_class = cinder.volume.api.API {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] volume_backend_name = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] volume_clear = zero {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] volume_clear_ionice = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] volume_clear_size = 0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] volume_copy_bps_limit = 0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] volume_dd_blocksize = 1M {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] volume_name_template = volume-%s {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] volume_service_inithost_offload = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] volume_usage_audit_period = month {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] zoning_mode = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_concurrency.disable_process_locking = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.auth_section = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.auth_type = password {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.auth_version = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.cache = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.certfile = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.delay_auth_decision = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.http_connect_timeout = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.include_service_catalog = True {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.insecure = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.interface = public {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.keyfile = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.memcache_password = **** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.memcache_username = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.region_name = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.service_token_roles_required = True {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.service_type = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.token_cache_time = 300 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.128/identity {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.backend = dogpile.cache.null {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.backend_argument = **** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.backend_expiration_time = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.config_prefix = cache.oslo {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.debug_cache_backend = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.enable_retry_client = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.enable_socket_keepalive = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.enabled = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.expiration_time = 600 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.hashclient_retry_attempts = 2 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.memcache_dead_retry = 300 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.memcache_pool_maxsize = 10 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.memcache_sasl_enabled = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.password = **** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.proxies = [] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.redis_db = 0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.redis_sentinel_service_name = mymaster {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.redis_server = localhost:6379 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.retry_attempts = 2 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.retry_delay = 0.0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.socket_keepalive_count = 1 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.socket_keepalive_idle = 1 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.socket_keepalive_interval = 1 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.socket_timeout = 1.0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.tls_allowed_ciphers = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.tls_cafile = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.tls_certfile = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.tls_enabled = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.tls_keyfile = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cache.username = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] coordination.backend_url = **** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] database.asyncio_connection = **** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] database.asyncio_slave_connection = **** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] database.backend = sqlalchemy {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] database.connection = **** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] database.connection_debug = 0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] database.connection_parameters = {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] database.connection_recycle_time = 3600 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] database.connection_trace = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78478]: INFO cinder.volume.manager [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] database.db_inc_retry_interval = True {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] database.db_max_retries = 20 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] database.db_max_retry_interval = 10 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] database.db_retry_interval = 1 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] database.max_overflow = 50 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] database.max_pool_size = 5 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] database.max_retries = 10 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] database.mysql_wsrep_sync_wait = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] database.pool_timeout = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] database.retry_interval = 10 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] database.slave_connection = **** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] database.sqlite_synchronous = True {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] database.synchronous_reader = True {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] database.use_db_reconnect = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_tracing.insecure = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] profiler.connection_string = messaging:// {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] profiler.enabled = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] profiler.es_doc_type = notification {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] profiler.es_scroll_size = 10000 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] profiler.es_scroll_time = 2m {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] profiler.filter_error_trace = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] profiler.hmac_keys = **** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] profiler.sentinel_service_name = mymaster {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] profiler.socket_timeout = 0.1 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] profiler.trace_requests = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] profiler.trace_sqlalchemy = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] profiler_jaeger.process_tags = {} {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] profiler_jaeger.service_name_prefix = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] profiler_otlp.service_name_prefix = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_policy.enforce_new_defaults = True {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_policy.policy_default_rule = default {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_policy.policy_file = policy.yaml {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_policy.remote_timeout = 60.0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] privsep_osbrick.group = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] privsep_osbrick.helper_command = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] privsep_osbrick.user = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cinder_sys_admin.group = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cinder_sys_admin.helper_command = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] cinder_sys_admin.user = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] service_user.auth_section = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] service_user.auth_type = password {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] service_user.cafile = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] service_user.certfile = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] service_user.collect_timing = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] service_user.insecure = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] service_user.keyfile = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] service_user.send_service_user_token = True {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] service_user.split_loggers = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] service_user.timeout = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] service_user.tls_ciphers = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] service_user.tls_min_version = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] glance.auth_section = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] glance.auth_type = password {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] glance.certfile = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] glance.collect_timing = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] glance.insecure = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] glance.keyfile = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] glance.region_name = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] glance.split_loggers = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] glance.timeout = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack sudo[78486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] glance.tls_ciphers = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] glance.tls_min_version = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.backend_availability_zone = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.chap_password = **** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.chap_username = {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack sudo[78486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.disk_geometry = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.driver_client_cert = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.driver_client_cert_key = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.driver_data_namespace = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.driver_use_ssl = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.enable_unsupported_driver = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.extra_capabilities = {} {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.filter_function = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.goodness_function = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.iscsi_target_flags = {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.iscsi_write_cache = on {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.iser_helper = tgtadm {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.iser_ip_address = 192.168.122.128 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.iser_port = 3260 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.lvm_mirrors = 0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.lvm_share_target = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.lvm_type = auto {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.num_shell_tries = 3 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.nvmet_port_id = 1 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.replication_device = **** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.report_discard_supported = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.reserved_percentage = 0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.scst_target_driver = iscsi {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.scst_target_iqn_name = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.storage_protocol = iSCSI {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.target_helper = tgtadm {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.target_ip_address = 192.168.122.128 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.target_port = 3260 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.target_protocol = iscsi {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.trace_flags = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.unique_fqdn_network = True {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.use_chap_auth = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.volume_backend_name = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.volume_clear = zero {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.volume_clear_ionice = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.volume_clear_size = 0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.volume_group = cinder-volumes {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_reports.file_event_handler = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_reports.log_dir = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.backend_availability_zone = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.backend_host = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.chap_password = **** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.chap_username = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.chiscsi_conf = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.disk_geometry = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.driver_client_cert = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.driver_data_namespace = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.driver_use_ssl = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.extra_capabilities = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.filter_function = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.goodness_function = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.iser_helper = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.iser_ip_address = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.iser_port = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.iser_target_prefix = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.lvm_conf_file = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.lvm_mirrors = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.lvm_share_target = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.lvm_type = auto {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.num_shell_tries = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.nvmet_port_id = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.replication_device = **** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.report_discard_supported = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.reserved_percentage = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.scst_target_driver = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.storage_protocol = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.target_helper = lioadm {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.target_ip_address = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.target_port = 3260 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.target_protocol = iscsi {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.trace_flags = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.use_chap_auth = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.volume_clear = zero {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.volume_clear_size = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] lvmdriver-1.volumes_dir = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.053s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.ssl = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.ssl_version = {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_notifications.driver = [] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_notifications.retry = -1 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] oslo_messaging_notifications.transport_url = **** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] key_manager.fixed_key = **** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican.barbican_api_version = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican.barbican_endpoint = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican.barbican_endpoint_type = public {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican.barbican_region_name = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican.cafile = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican.certfile = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican.collect_timing = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican.insecure = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican.keyfile = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican.number_of_retries = 60 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican.retry_delay = 1 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican.send_service_user_token = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican.split_loggers = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican.timeout = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican.tls_ciphers = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican.tls_min_version = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican.verify_ssl = True {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican.verify_ssl_path = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican_service_user.auth_section = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican_service_user.auth_type = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican_service_user.cafile = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican_service_user.certfile = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican_service_user.collect_timing = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican_service_user.insecure = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican_service_user.keyfile = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican_service_user.split_loggers = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican_service_user.timeout = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican_service_user.tls_ciphers = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] barbican_service_user.tls_min_version = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] vault.approle_role_id = **** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] vault.approle_secret_id = **** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] vault.auth_method = approle {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] vault.auth_path = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] vault.kv_mountpoint = secret {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] vault.kv_path = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] vault.kv_version = 2 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] vault.namespace = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] vault.root_token_id = **** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] vault.ssl_ca_crt_file = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] vault.timeout = 60.0 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] vault.token_file = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] vault.token_role = None {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] vault.use_ssl = False {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:55:33 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] ******************************************************************************** {{(pid=78330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 05 04:55:33 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:33 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:33 devstack sudo[78486]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:33 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:33 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:33 devstack sudo[78489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:55:33 devstack sudo[78489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:34 devstack sudo[78489]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:34 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.315s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:34 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:55:34 devstack cinder-volume[78478]: INFO cinder.brick.local_dev.lvm [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 05 04:55:34 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:34 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:34 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:34 devstack sudo[78596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:55:34 devstack sudo[78596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:34 devstack sudo[78596]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:34 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:34 devstack cinder-volume[78478]: DEBUG cinder.brick.local_dev.lvm [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=78478) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 05 04:55:34 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:34 devstack sudo[78694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:55:34 devstack sudo[78694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:34 devstack sudo[78694]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:34 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.518s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:34 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:34 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:34 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:34 devstack sudo[78892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:55:34 devstack sudo[78892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:35 devstack sudo[78892]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:35 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:35 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:35 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:35 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:35 devstack sudo[78995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 05 04:55:35 devstack sudo[78995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:35 devstack sudo[78995]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:35 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.327s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:35 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:35 devstack sudo[79097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:55:35 devstack sudo[79097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:35 devstack sudo[79097]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:35 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:35 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:35 devstack sudo[79100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:55:35 devstack sudo[79100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:36 devstack sudo[79100]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:36 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.364s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:36 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:36 devstack sudo[79184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:55:36 devstack sudo[79184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:36 devstack sudo[79184]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:36 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:36 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:36 devstack sudo[79191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:55:36 devstack sudo[79191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:36 devstack sudo[79191]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:36 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.292s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:36 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:36 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:36 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:36 devstack sudo[79247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:55:36 devstack sudo[79247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:37 devstack sudo[79247]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:37 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:37 devstack cinder-volume[78478]: INFO cinder.volume.drivers.lvm [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 05 04:55:37 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:37 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:37 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:37 devstack sudo[79287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:55:37 devstack sudo[79287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:37 devstack sudo[79287]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:37 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:37 devstack cinder-volume[78478]: DEBUG cinder.volume.drivers.lvm [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Updating volume stats {{(pid=78478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 04:55:37 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:37 devstack sudo[79290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:55:37 devstack sudo[79290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:37 devstack sudo[79290]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:37 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:37 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:37 devstack sudo[79293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:55:37 devstack sudo[79293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:37 devstack sudo[79293]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:37 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:37 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:37 devstack sudo[79296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:55:37 devstack sudo[79296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:38 devstack sudo[79296]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:38 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:38 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:38 devstack sudo[79299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:55:38 devstack sudo[79299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:38 devstack sudo[79299]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:38 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:38 devstack cinder-volume[78478]: INFO cinder.volume.driver [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Driver hasn't implemented _init_vendor_properties() Sep 05 04:55:38 devstack cinder-volume[78478]: DEBUG cinder.volume.driver [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=78478) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 05 04:55:38 devstack cinder-volume[78478]: DEBUG oslo_db.sqlalchemy.engines [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78478) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 04:55:38 devstack cinder-volume[78478]: DEBUG dbcounter [-] [78478] Writer thread running {{(pid=78478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 04:55:38 devstack cinder-volume[78478]: DEBUG cinder.db.api [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Building query based on filter {{(pid=78478) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 05 04:55:38 devstack cinder-volume[78478]: DEBUG cinder.image.image_utils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=78478) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 05 04:55:38 devstack cinder-volume[78478]: INFO cinder.keymgr.migration [None req-fa6765ea-1b62-4b94-81cc-3fea4513fbe1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 05 04:55:38 devstack cinder-volume[78478]: DEBUG cinder.volume.drivers.lvm [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Updating volume stats {{(pid=78478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 04:55:38 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:38 devstack sudo[79302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:55:38 devstack sudo[79302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:38 devstack sudo[79302]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:38 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:38 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:38 devstack sudo[79305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:55:38 devstack sudo[79305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:39 devstack sudo[79305]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:39 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:39 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:39 devstack sudo[79311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:55:39 devstack sudo[79311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:39 devstack sudo[79311]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:39 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:39 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:39 devstack sudo[79314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:55:39 devstack sudo[79314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:39 devstack sudo[79314]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:39 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:39 devstack cinder-volume[78478]: DEBUG cinder.manager [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Notifying Schedulers of capabilities ... {{(pid=78478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:55:39 devstack cinder-volume[78478]: INFO cinder.volume.manager [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Driver initialization completed successfully. Sep 05 04:55:39 devstack cinder-volume[78478]: INFO cinder.manager [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Initiating service 2 cleanup Sep 05 04:55:39 devstack cinder-volume[78478]: INFO cinder.manager [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Service 2 cleanup completed. Sep 05 04:55:39 devstack cinder-volume[78478]: DEBUG cinder.service [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Creating RPC server for service cinder-volume {{(pid=78478) start /opt/stack/cinder/cinder/service.py:231}} Sep 05 04:55:39 devstack cinder-volume[78478]: DEBUG cinder.service [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=78478) start /opt/stack/cinder/cinder/service.py:237}} Sep 05 04:55:39 devstack cinder-volume[78478]: INFO cinder.volume.manager [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 05 04:55:39 devstack cinder-volume[78478]: DEBUG cinder.volume.drivers.lvm [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Updating volume stats {{(pid=78478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 04:55:39 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:39 devstack sudo[79317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:55:39 devstack sudo[79317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:40 devstack sudo[79317]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:40 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:40 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:40 devstack sudo[79323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:55:40 devstack sudo[79323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:40 devstack sudo[79323]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:40 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:40 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:40 devstack sudo[79328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:55:40 devstack sudo[79328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:40 devstack sudo[79328]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:40 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:40 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:40 devstack sudo[79331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:55:40 devstack sudo[79331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:40 devstack sudo[79331]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:40 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:40 devstack cinder-volume[78478]: INFO cinder.volume.manager [None req-59dc62b7-26d9-4fef-ab75-dfca8ed6b0b1 None None] Driver post RPC initialization completed successfully. Sep 05 04:55:43 devstack cinder-volume[78330]: DEBUG dbcounter [-] [78330] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=78330) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:55:45 devstack cinder-volume[78478]: DEBUG oslo_service.periodic_task [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running periodic task VolumeManager._thread_info {{(pid=78478) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:55:45 devstack cinder-volume[78478]: DEBUG cinder.volume.manager [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] thread count: 6 {{(pid=78478) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:55:45 devstack cinder-volume[78478]: DEBUG cinder.volume.manager [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] thread info: [<_MainThread(MainThread, started 126772821463168)>, , , , , ] {{(pid=78478) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:55:50 devstack cinder-volume[78478]: DEBUG dbcounter [-] [78478] Writing DB stats cinder:SELECT=4 {{(pid=78478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:55:50 devstack cinder-volume[78478]: DEBUG dbcounter [-] [78478] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=78478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:56:45 devstack cinder-volume[78478]: DEBUG oslo_service.periodic_task [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78478) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:56:45 devstack cinder-volume[78478]: DEBUG cinder.volume.drivers.lvm [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Updating volume stats {{(pid=78478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 04:56:45 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:56:45 devstack sudo[81436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:56:45 devstack sudo[81436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:56:46 devstack sudo[81436]: pam_unix(sudo:session): session closed for user root Sep 05 04:56:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:56:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:56:46 devstack sudo[81439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:56:46 devstack sudo[81439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:56:46 devstack sudo[81439]: pam_unix(sudo:session): session closed for user root Sep 05 04:56:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:56:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:56:46 devstack sudo[81442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:56:46 devstack sudo[81442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:56:46 devstack sudo[81442]: pam_unix(sudo:session): session closed for user root Sep 05 04:56:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:56:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:56:46 devstack sudo[81445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:56:46 devstack sudo[81445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:56:46 devstack sudo[81445]: pam_unix(sudo:session): session closed for user root Sep 05 04:56:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:56:46 devstack cinder-volume[78478]: DEBUG cinder.manager [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Notifying Schedulers of capabilities ... {{(pid=78478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:56:46 devstack cinder-volume[78478]: DEBUG oslo_service.periodic_task [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running periodic task VolumeManager._thread_info {{(pid=78478) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:56:46 devstack cinder-volume[78478]: DEBUG cinder.volume.manager [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] thread count: 6 {{(pid=78478) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:56:46 devstack cinder-volume[78478]: DEBUG cinder.volume.manager [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] thread info: [<_MainThread(MainThread, started 126772821463168)>, , , , , ] {{(pid=78478) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:57:45 devstack cinder-volume[78478]: DEBUG oslo_service.periodic_task [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78478) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:57:45 devstack cinder-volume[78478]: DEBUG cinder.volume.drivers.lvm [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Updating volume stats {{(pid=78478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 04:57:45 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:45 devstack sudo[84809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:57:45 devstack sudo[84809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:46 devstack sudo[84809]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:46 devstack sudo[84816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:57:46 devstack sudo[84816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:46 devstack sudo[84816]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:46 devstack sudo[84820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:57:46 devstack sudo[84820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:46 devstack sudo[84820]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:46 devstack sudo[84823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:57:46 devstack sudo[84823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:46 devstack sudo[84823]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:46 devstack cinder-volume[78478]: DEBUG cinder.manager [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Notifying Schedulers of capabilities ... {{(pid=78478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:57:46 devstack cinder-volume[78478]: DEBUG oslo_service.periodic_task [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running periodic task VolumeManager._thread_info {{(pid=78478) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:57:46 devstack cinder-volume[78478]: DEBUG cinder.volume.manager [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] thread count: 6 {{(pid=78478) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:57:46 devstack cinder-volume[78478]: DEBUG cinder.volume.manager [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] thread info: [<_MainThread(MainThread, started 126772821463168)>, , , , , ] {{(pid=78478) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:57:50 devstack cinder-volume[78478]: DEBUG dbcounter [-] [78478] Writing DB stats cinder:SELECT=1 {{(pid=78478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:57:50 devstack cinder-volume[78478]: DEBUG dbcounter [-] [78478] Writing DB stats cinder:UPDATE=1 {{(pid=78478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:58:45 devstack cinder-volume[78478]: DEBUG oslo_service.periodic_task [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78478) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:58:45 devstack cinder-volume[78478]: DEBUG cinder.volume.drivers.lvm [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Updating volume stats {{(pid=78478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 04:58:45 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:45 devstack sudo[86971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:58:45 devstack sudo[86971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:46 devstack sudo[86971]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:46 devstack sudo[86978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:58:46 devstack sudo[86978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:46 devstack sudo[86978]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:46 devstack sudo[86983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:58:46 devstack sudo[86983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:46 devstack sudo[86983]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:46 devstack sudo[86989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:58:46 devstack sudo[86989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:46 devstack sudo[86989]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:46 devstack cinder-volume[78478]: DEBUG cinder.manager [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Notifying Schedulers of capabilities ... {{(pid=78478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:46 devstack cinder-volume[78478]: DEBUG oslo_service.periodic_task [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running periodic task VolumeManager._thread_info {{(pid=78478) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:58:46 devstack cinder-volume[78478]: DEBUG cinder.volume.manager [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] thread count: 6 {{(pid=78478) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:58:46 devstack cinder-volume[78478]: DEBUG cinder.volume.manager [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] thread info: [<_MainThread(MainThread, started 126772821463168)>, , , , , ] {{(pid=78478) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:59:45 devstack cinder-volume[78478]: DEBUG oslo_service.periodic_task [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78478) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:59:45 devstack cinder-volume[78478]: DEBUG cinder.volume.drivers.lvm [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Updating volume stats {{(pid=78478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 04:59:45 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:45 devstack sudo[88181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:59:45 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:46 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:46 devstack sudo[88184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:59:46 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:46 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:46 devstack sudo[88205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:59:46 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:46 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:46 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:46 devstack sudo[88213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:59:46 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:47 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:47 devstack cinder-volume[78478]: DEBUG oslo_concurrency.processutils [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=78478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:47 devstack cinder-volume[78478]: DEBUG cinder.manager [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Notifying Schedulers of capabilities ... {{(pid=78478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:59:47 devstack cinder-volume[78478]: DEBUG oslo_service.periodic_task [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] Running periodic task VolumeManager._thread_info {{(pid=78478) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:59:47 devstack cinder-volume[78478]: DEBUG cinder.volume.manager [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] thread count: 6 {{(pid=78478) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:59:47 devstack cinder-volume[78478]: DEBUG cinder.volume.manager [None req-6ebd6d1e-9d66-4da3-bde4-2cafacb2b854 None None] thread info: [<_MainThread(MainThread, started 126772821463168)>, , , , , ] {{(pid=78478) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:59:50 devstack cinder-volume[78478]: DEBUG dbcounter [-] [78478] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=78478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:59:54 devstack cinder-volume[78330]: INFO oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Caught SIGTERM, stopping children Sep 05 04:59:54 devstack cinder-volume[78330]: DEBUG oslo_concurrency.lockutils [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Acquiring lock "singleton_lock" {{(pid=78330) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 04:59:54 devstack cinder-volume[78330]: DEBUG oslo_concurrency.lockutils [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Acquired lock "singleton_lock" {{(pid=78330) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 04:59:54 devstack cinder-volume[78330]: DEBUG oslo_concurrency.lockutils [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Releasing lock "singleton_lock" {{(pid=78330) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 04:59:54 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Stop services. {{(pid=78330) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 05 04:59:54 devstack cinder-volume[78330]: DEBUG oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Killing children. {{(pid=78330) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 05 04:59:54 devstack cinder-volume[78330]: INFO oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Waiting on 1 children to exit Sep 05 04:59:59 devstack cinder-volume[78478]: DEBUG oslo_concurrency.lockutils [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Acquiring lock "singleton_lock" {{(pid=78478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 04:59:59 devstack cinder-volume[78478]: DEBUG oslo_concurrency.lockutils [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Acquired lock "singleton_lock" {{(pid=78478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 04:59:59 devstack cinder-volume[78478]: DEBUG oslo_concurrency.lockutils [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Releasing lock "singleton_lock" {{(pid=78478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 04:59:59 devstack cinder-volume[78478]: WARNING amqp [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 05 04:59:59 devstack cinder-volume[78478]: WARNING amqp [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 05 04:59:59 devstack cinder-volume[78330]: INFO oslo_service.backend._eventlet.service [None req-3fa72499-c5cd-4acc-997c-b4b28280d814 None None] Child 78478 exited with status 0 Sep 05 05:00:00 devstack cinder-volume[88530]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 05 05:00:00 devstack cinder-volume[88530]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 05 05:00:00 devstack cinder-volume[88530]: we strongly recommend against using it for new projects. Sep 05 05:00:00 devstack cinder-volume[88530]: If you are already using Eventlet, we recommend migrating to a different Sep 05 05:00:00 devstack cinder-volume[88530]: framework. For more detail see Sep 05 05:00:00 devstack cinder-volume[88530]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 05 05:00:00 devstack cinder-volume[88530]: import eventlet # noqa Sep 05 05:00:02 devstack cinder-volume[88530]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88530) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 05:00:02 devstack cinder-volume[88530]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88530) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 05:00:02 devstack cinder-volume[88530]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88530) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 05:00:02 devstack cinder-volume[88530]: INFO dbcounter [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Registered counter for database cinder Sep 05 05:00:02 devstack cinder-volume[88530]: DEBUG oslo_db.sqlalchemy.engines [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88530) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG dbcounter [-] [88530] Writer thread running {{(pid=88530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 05:00:03 devstack cinder-volume[88530]: INFO cinder.rpc [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 05 05:00:03 devstack cinder-volume[88530]: INFO cinder.rpc [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_db.sqlalchemy.engines [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88530) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 05:00:03 devstack cinder-volume[88530]: INFO cinder.volume.manager [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Determined volume DB was empty at startup. Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG cinder.volume.manager [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88530) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 05 05:00:03 devstack cinder-volume[88530]: INFO cinder.volume.manager [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 05 05:00:03 devstack cinder-volume[88530]: WARNING stevedore.named [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 05 05:00:03 devstack cinder-volume[88530]: WARNING castellan.key_manager [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 05:00:03 devstack cinder-volume[88530]: WARNING cinder.keymgr.conf_key_mgr [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 05:00:03 devstack cinder-volume[88530]: INFO cinder.volume.manager [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_db.sqlalchemy.engines [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88530) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 05:00:03 devstack cinder-volume[88530]: INFO oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Starting 1 workers Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Started child 88747 {{(pid=88530) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Full set of CONF: {{(pid=88530) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] ******************************************************************************** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Configuration options gathered from: {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] ================================================================================ {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] allow_availability_zone_fallback = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] allow_compression_on_image_upload = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] allowed_direct_url_schemes = [] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] api_rate_limit = True {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] auth_strategy = keystone {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_availability_zone = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_host = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_name = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_stats_polling_interval = 60 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backup_api_class = cinder.backup.api.API {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backup_name_template = backup-%s {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backup_use_same_host = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backup_use_temp_snapshot = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] chap_password = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] chap_username = {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88747]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cinder_internal_tenant_project_id = c268ecf0b76c40019ddef0e6da15f5d4 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cinder_internal_tenant_user_id = 980201c4fe57468c95df93628f3ca296 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cluster = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] compression_format = gzip {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] compute_api_class = cinder.compute.nova.API {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] config_dir = [] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] config_source = [] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] control_exchange = openstack {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] debug = True {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] default_availability_zone = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] default_group_type = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] default_volume_type = QuobyteHD {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] disk_geometry = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] driver_client_cert = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] driver_client_cert_key = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] driver_data_namespace = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] driver_ssl_cert_path = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] driver_ssl_cert_verify = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] driver_use_ssl = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] enable_new_services = True {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] enable_unsupported_driver = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] enabled_backends = ['QuobyteHD'] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] enforce_multipath_for_image_xfer = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] filter_function = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] glance_api_insecure = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] glance_api_servers = ['http://192.168.122.128/image'] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] glance_api_ssl_compression = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] glance_ca_certificates_file = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] glance_catalog_info = image:glance:publicURL {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] glance_certfile = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] glance_keyfile = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] glance_num_retries = 3 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] glance_request_timeout = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] goodness_function = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] graceful_shutdown_timeout = 5 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] group_api_class = cinder.group.api.API {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] host = devstack {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] image_compress_on_upload = True {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] image_conversion_address_space_limit = 1 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] image_conversion_cpu_limit = 60 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] image_conversion_disable = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] image_upload_use_cinder_backend = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] image_upload_use_internal_tenant = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] image_volume_cache_enabled = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] image_volume_cache_max_count = 0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] image_volume_cache_max_size_gb = 0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] init_host_max_objects_retrieval = 0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] instance_format = [instance: %(uuid)s] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] iscsi_target_flags = {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] iscsi_write_cache = on {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] iser_helper = tgtadm {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] iser_ip_address = 192.168.122.128 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] iser_port = 3260 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] log_color = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] log_config_append = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] log_dir = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] log_file = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] log_options = True {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] log_rotate_interval = 1 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] log_rotate_interval_type = days {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] log_rotation_type = none {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] max_age = 0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] max_logfile_count = 30 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] max_logfile_size_mb = 200 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] max_over_subscription_ratio = 20.0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] message_reap_interval = 86400 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] message_ttl = 2592000 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] migration_create_volume_timeout_secs = 300 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] monkey_patch = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] monkey_patch_modules = [] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] my_ip = 192.168.122.128 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] no_snapshot_gb_quota = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] num_iser_scan_tries = 3 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] num_shell_tries = 3 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] num_volume_device_scan_tries = 3 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] nvmeof_conn_info_version = 1 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] nvmet_ns_id = 10 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] nvmet_port_id = 1 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] osapi_max_limit = 1000 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] osapi_volume_ext_list = [] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] osapi_volume_listen_port = 8776 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] osapi_volume_use_ssl = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] osapi_volume_workers = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] per_volume_size_limit = -1 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] periodic_fuzzy_delay = 60 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] periodic_interval = 60 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] public_endpoint = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] publish_errors = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] quota_backup_gigabytes = 1000 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] quota_backups = 10 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] quota_gigabytes = 1000 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] quota_groups = 10 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] quota_snapshots = 10 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] quota_volumes = 10 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] rate_limit_burst = 0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] rate_limit_except_level = CRITICAL {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] rate_limit_interval = 0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] reinit_driver_count = 3 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] replication_device = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] report_discard_supported = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] report_interval = 120 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] reservation_clean_interval = 86400 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] reservation_expire = 86400 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] reserved_image_namespaces = [] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] reserved_percentage = 0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] rpc_response_timeout = 120 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] run_external_periodic_tasks = True {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] scst_target_driver = iscsi {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] scst_target_iqn_name = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] service_down_time = 720 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] shell_completion = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] snapshot_name_template = snapshot-%s {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] split_loggers = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] state_path = /opt/stack/data/cinder {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] storage_availability_zone = nova {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] storage_protocol = iSCSI {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] syslog_log_facility = LOG_USER {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] target_helper = lioadm {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] target_ip_address = 192.168.122.128 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] target_port = 3260 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] target_protocol = iscsi {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] target_secondary_ip_addresses = [] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] trace_flags = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] transport_url = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] until_refresh = 0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] use_chap_auth = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] use_default_quota_class = True {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] use_journal = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] use_json = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] use_multipath_for_image_xfer = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] use_stderr = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] use_syslog = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] verify_glance_signatures = enabled {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] volume_api_class = cinder.volume.api.API {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] volume_backend_name = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] volume_clear = zero {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] volume_clear_ionice = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] volume_clear_size = 0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] volume_copy_bps_limit = 0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] volume_dd_blocksize = 1M {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] volume_name_template = volume-%s {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88747]: INFO cinder.volume.manager [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] volume_service_inithost_offload = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88747]: DEBUG cinder.volume.drivers.remotefs [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88747) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] volume_usage_audit_period = month {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] zoning_mode = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_concurrency.disable_process_locking = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.auth_section = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.auth_type = password {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.auth_version = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.cache = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.certfile = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.include_service_catalog = True {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.insecure = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.interface = public {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.keyfile = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.memcache_password = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.memcache_username = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.region_name = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.service_type = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.128/identity {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.backend = dogpile.cache.null {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.backend_argument = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.backend_expiration_time = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.config_prefix = cache.oslo {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.debug_cache_backend = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.enable_retry_client = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.enable_socket_keepalive = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.enabled = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.expiration_time = 600 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.hashclient_retry_attempts = 2 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.memcache_dead_retry = 300 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.memcache_pool_maxsize = 10 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.memcache_sasl_enabled = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.password = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.proxies = [] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.redis_db = 0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.redis_server = localhost:6379 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.retry_attempts = 2 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.retry_delay = 0.0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.socket_keepalive_count = 1 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.socket_keepalive_idle = 1 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.socket_keepalive_interval = 1 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.socket_timeout = 1.0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.tls_allowed_ciphers = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.tls_cafile = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.tls_certfile = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.tls_enabled = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.tls_keyfile = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cache.username = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] coordination.backend_url = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] database.asyncio_connection = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] database.asyncio_slave_connection = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] database.backend = sqlalchemy {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] database.connection = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] database.connection_debug = 0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] database.connection_parameters = {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] database.connection_recycle_time = 3600 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] database.connection_trace = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] database.db_inc_retry_interval = True {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] database.db_max_retries = 20 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] database.db_max_retry_interval = 10 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] database.db_retry_interval = 1 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] database.max_overflow = 50 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] database.max_pool_size = 5 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] database.max_retries = 10 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] database.mysql_wsrep_sync_wait = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] database.pool_timeout = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] database.retry_interval = 10 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] database.slave_connection = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] database.sqlite_synchronous = True {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] database.synchronous_reader = True {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] database.use_db_reconnect = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_tracing.insecure = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] profiler.connection_string = messaging:// {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] profiler.enabled = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] profiler.es_doc_type = notification {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] profiler.es_scroll_size = 10000 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] profiler.es_scroll_time = 2m {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] profiler.filter_error_trace = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] profiler.hmac_keys = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] profiler.sentinel_service_name = mymaster {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] profiler.socket_timeout = 0.1 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] profiler.trace_requests = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] profiler.trace_sqlalchemy = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] profiler_jaeger.process_tags = {} {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] profiler_jaeger.service_name_prefix = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] profiler_otlp.service_name_prefix = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_policy.enforce_new_defaults = True {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_policy.policy_default_rule = default {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_policy.policy_file = policy.yaml {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] privsep_osbrick.group = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] privsep_osbrick.helper_command = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] privsep_osbrick.user = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cinder_sys_admin.group = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cinder_sys_admin.helper_command = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] cinder_sys_admin.user = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] service_user.auth_section = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] service_user.auth_type = password {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] service_user.cafile = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] service_user.certfile = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] service_user.collect_timing = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] service_user.insecure = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] service_user.keyfile = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] service_user.send_service_user_token = True {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] service_user.split_loggers = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] service_user.timeout = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] service_user.tls_ciphers = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] service_user.tls_min_version = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] glance.auth_section = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] glance.auth_type = password {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] glance.certfile = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] glance.collect_timing = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] glance.insecure = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] glance.keyfile = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] glance.region_name = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] glance.split_loggers = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] glance.timeout = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] glance.tls_ciphers = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] glance.tls_min_version = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.backend_availability_zone = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.chap_password = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.chap_username = {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.disk_geometry = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.driver_client_cert = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.driver_client_cert_key = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.driver_data_namespace = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.driver_use_ssl = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.extra_capabilities = {} {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.filter_function = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.goodness_function = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.iscsi_target_flags = {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.iscsi_write_cache = on {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.iser_helper = tgtadm {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.iser_ip_address = 192.168.122.128 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.iser_port = 3260 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.nas_host = {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.nas_login = admin {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.nas_mount_options = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.nas_password = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.nas_private_key = {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.nas_share_path = {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.num_shell_tries = 3 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88747]: DEBUG cinder.volume.drivers.quobyte [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88747) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 05 05:00:03 devstack cinder-volume[88747]: WARNING cinder.volume.drivers.quobyte [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 05 05:00:03 devstack cinder-volume[88747]: WARNING cinder.volume.drivers.quobyte [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.quobyte_volume_url = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.replication_device = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.report_discard_supported = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.reserved_percentage = 0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.target_helper = tgtadm {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.target_ip_address = 192.168.122.128 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.target_port = 3260 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.target_protocol = iscsi {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88747]: DEBUG oslo_concurrency.processutils [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Running cmd (subprocess): mount.quobyte {{(pid=88747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.trace_flags = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.unique_fqdn_network = True {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.use_chap_auth = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.volume_backend_name = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.volume_clear = zero {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.volume_clear_ionice = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.volume_clear_size = 0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_reports.file_event_handler = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_reports.log_dir = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.backend_availability_zone = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.backend_host = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.chap_password = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.chap_username = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.chiscsi_conf = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.disk_geometry = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.driver_client_cert = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.driver_data_namespace = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.driver_use_ssl = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.extra_capabilities = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.filter_function = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.goodness_function = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.iser_helper = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.iser_ip_address = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.iser_port = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.iser_target_prefix = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.nas_host = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.nas_login = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.nas_mount_options = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.nas_password = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.nas_private_key = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.nas_share_path = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.nas_ssh_port = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.num_shell_tries = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.nvmet_port_id = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.replication_device = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.report_discard_supported = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.reserved_percentage = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.scst_target_driver = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.storage_protocol = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.target_helper = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.target_ip_address = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.target_port = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.target_prefix = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.target_protocol = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.trace_flags = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.use_chap_auth = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.volume_clear = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.volume_clear_size = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] QuobyteHD.volumes_dir = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.ssl = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_notifications.driver = [] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_notifications.retry = -1 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] key_manager.fixed_key = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican.barbican_api_version = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican.barbican_endpoint = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican.barbican_endpoint_type = public {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican.barbican_region_name = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican.cafile = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican.certfile = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican.collect_timing = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican.insecure = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican.keyfile = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican.number_of_retries = 60 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican.retry_delay = 1 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican.send_service_user_token = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican.split_loggers = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican.timeout = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican.tls_ciphers = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican.tls_min_version = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican.verify_ssl = True {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican.verify_ssl_path = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican_service_user.auth_section = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican_service_user.auth_type = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican_service_user.cafile = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican_service_user.certfile = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican_service_user.collect_timing = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican_service_user.insecure = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican_service_user.keyfile = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican_service_user.split_loggers = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican_service_user.timeout = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican_service_user.tls_ciphers = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] barbican_service_user.tls_min_version = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] vault.approle_role_id = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] vault.approle_secret_id = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] vault.auth_method = approle {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] vault.auth_path = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] vault.kv_mountpoint = secret {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] vault.kv_path = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] vault.kv_version = 2 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] vault.namespace = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack quobyte-client[88748]: Reading configuration file: /etc/quobyte/client.cfg Sep 05 05:00:03 devstack quobyte-client[88748]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] vault.root_token_id = **** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] vault.ssl_ca_crt_file = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] vault.timeout = 60.0 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] vault.token_file = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88747]: DEBUG oslo_concurrency.processutils [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] CMD "mount.quobyte" returned: 1 in 0.115s {{(pid=88747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:03 devstack cinder-volume[88747]: DEBUG oslo_concurrency.lockutils [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:00:03 devstack cinder-volume[88747]: DEBUG oslo_concurrency.lockutils [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:00:03 devstack cinder-volume[88747]: DEBUG cinder.volume.drivers.quobyte [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=88747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] vault.token_role = None {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] vault.use_ssl = False {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:03 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] ******************************************************************************** {{(pid=88530) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 05 05:00:03 devstack cinder-volume[88747]: INFO cinder.volume.drivers.quobyte [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 ... Sep 05 05:00:03 devstack cinder-volume[88747]: DEBUG oslo_concurrency.processutils [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 -c /etc/quobyte/client-cinder.cfg {{(pid=88747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:03 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 -c /etc/quobyte/client-cinder.cfg Sep 05 05:00:03 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:04 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:04 devstack cinder-volume[88747]: DEBUG oslo_concurrency.processutils [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.408s {{(pid=88747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:04 devstack cinder-volume[88747]: INFO cinder.volume.drivers.quobyte [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 succeeded Sep 05 05:00:04 devstack cinder-volume[88747]: DEBUG cinder.volume.drivers.quobyte [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=88747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:00:04 devstack cinder-volume[88747]: DEBUG oslo_concurrency.lockutils [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.421s {{(pid=88747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:00:04 devstack cinder-volume[88747]: DEBUG oslo_concurrency.processutils [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=88747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:04 devstack sudo[88822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:00:04 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:04 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:04 devstack cinder-volume[88747]: DEBUG oslo_concurrency.processutils [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.239s {{(pid=88747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:04 devstack cinder-volume[88747]: INFO cinder.volume.driver [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Driver hasn't implemented _init_vendor_properties() Sep 05 05:00:04 devstack cinder-volume[88747]: DEBUG cinder.volume.driver [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6874046325684, 'free_capacity_gb': 1773.6874046325684, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88747) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 05 05:00:04 devstack cinder-volume[88747]: DEBUG oslo_db.sqlalchemy.engines [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88747) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 05:00:04 devstack cinder-volume[88747]: DEBUG dbcounter [-] [88747] Writer thread running {{(pid=88747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 05:00:04 devstack cinder-volume[88747]: DEBUG cinder.db.api [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Building query based on filter {{(pid=88747) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 05 05:00:04 devstack cinder-volume[88747]: DEBUG cinder.image.image_utils [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88747) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 05 05:00:04 devstack cinder-volume[88747]: INFO cinder.keymgr.migration [None req-093c2b60-73ad-45fe-a7a8-e4a4d6d018a9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 05 05:00:04 devstack cinder-volume[88747]: DEBUG oslo_concurrency.lockutils [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:00:04 devstack cinder-volume[88747]: DEBUG oslo_concurrency.lockutils [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:00:04 devstack cinder-volume[88747]: DEBUG cinder.volume.drivers.quobyte [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=88747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:00:04 devstack cinder-volume[88747]: DEBUG cinder.volume.drivers.quobyte [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=88747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:00:04 devstack cinder-volume[88747]: DEBUG oslo_concurrency.lockutils [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:00:04 devstack cinder-volume[88747]: DEBUG oslo_concurrency.processutils [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=88747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:04 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:00:04 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:04 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:04 devstack cinder-volume[88747]: DEBUG oslo_concurrency.processutils [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.223s {{(pid=88747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:04 devstack cinder-volume[88747]: DEBUG cinder.manager [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Notifying Schedulers of capabilities ... {{(pid=88747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:00:04 devstack cinder-volume[88747]: INFO cinder.volume.manager [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Driver initialization completed successfully. Sep 05 05:00:04 devstack cinder-volume[88747]: INFO cinder.manager [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Initiating service 3 cleanup Sep 05 05:00:04 devstack cinder-volume[88747]: INFO cinder.manager [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Service 3 cleanup completed. Sep 05 05:00:04 devstack cinder-volume[88747]: DEBUG cinder.service [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Creating RPC server for service cinder-volume {{(pid=88747) start /opt/stack/cinder/cinder/service.py:231}} Sep 05 05:00:04 devstack cinder-volume[88747]: DEBUG cinder.service [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88747) start /opt/stack/cinder/cinder/service.py:237}} Sep 05 05:00:05 devstack cinder-volume[88747]: INFO cinder.volume.manager [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 05 05:00:05 devstack cinder-volume[88747]: DEBUG oslo_concurrency.lockutils [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:00:05 devstack cinder-volume[88747]: DEBUG oslo_concurrency.lockutils [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:00:05 devstack cinder-volume[88747]: DEBUG cinder.volume.drivers.quobyte [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=88747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:00:05 devstack cinder-volume[88747]: DEBUG cinder.volume.drivers.quobyte [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=88747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:00:05 devstack cinder-volume[88747]: DEBUG oslo_concurrency.lockutils [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:00:05 devstack cinder-volume[88747]: DEBUG oslo_concurrency.processutils [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=88747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:05 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:00:05 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:05 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:05 devstack cinder-volume[88747]: DEBUG oslo_concurrency.processutils [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.260s {{(pid=88747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:05 devstack cinder-volume[88747]: INFO cinder.volume.manager [None req-87933eef-0423-4ea2-9b47-29e2b105c066 None None] Driver post RPC initialization completed successfully. Sep 05 05:00:09 devstack cinder-volume[88747]: DEBUG oslo_concurrency.lockutils [None req-5fd303db-fd46-4e54-9d69-7419658f7c9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:00:09 devstack cinder-volume[88747]: DEBUG oslo_concurrency.lockutils [None req-5fd303db-fd46-4e54-9d69-7419658f7c9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:00:09 devstack cinder-volume[88747]: DEBUG cinder.volume.drivers.quobyte [None req-5fd303db-fd46-4e54-9d69-7419658f7c9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=88747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:00:09 devstack cinder-volume[88747]: DEBUG cinder.volume.drivers.quobyte [None req-5fd303db-fd46-4e54-9d69-7419658f7c9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=88747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:00:09 devstack cinder-volume[88747]: DEBUG oslo_concurrency.lockutils [None req-5fd303db-fd46-4e54-9d69-7419658f7c9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:00:09 devstack cinder-volume[88747]: DEBUG oslo_concurrency.processutils [None req-5fd303db-fd46-4e54-9d69-7419658f7c9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=88747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:09 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:00:09 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:09 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:09 devstack cinder-volume[88747]: DEBUG oslo_concurrency.processutils [None req-5fd303db-fd46-4e54-9d69-7419658f7c9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.229s {{(pid=88747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:09 devstack cinder-volume[88747]: DEBUG cinder.manager [None req-5fd303db-fd46-4e54-9d69-7419658f7c9b None None] Notifying Schedulers of capabilities ... {{(pid=88747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:00:10 devstack cinder-volume[88530]: INFO oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Caught SIGTERM, stopping children Sep 05 05:00:10 devstack cinder-volume[88530]: DEBUG oslo_concurrency.lockutils [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Acquiring lock "singleton_lock" {{(pid=88530) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 05:00:10 devstack cinder-volume[88530]: DEBUG oslo_concurrency.lockutils [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Acquired lock "singleton_lock" {{(pid=88530) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 05:00:10 devstack cinder-volume[88530]: DEBUG oslo_concurrency.lockutils [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Releasing lock "singleton_lock" {{(pid=88530) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 05:00:10 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Stop services. {{(pid=88530) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 05 05:00:10 devstack cinder-volume[88530]: DEBUG oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Killing children. {{(pid=88530) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 05 05:00:10 devstack cinder-volume[88530]: INFO oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Waiting on 1 children to exit Sep 05 05:00:13 devstack cinder-volume[88747]: DEBUG oslo_concurrency.lockutils [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Acquiring lock "singleton_lock" {{(pid=88747) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 05:00:13 devstack cinder-volume[88747]: DEBUG oslo_concurrency.lockutils [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Acquired lock "singleton_lock" {{(pid=88747) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 05:00:13 devstack cinder-volume[88747]: DEBUG oslo_concurrency.lockutils [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Releasing lock "singleton_lock" {{(pid=88747) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 05:00:13 devstack cinder-volume[88747]: WARNING amqp [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 05 05:00:13 devstack cinder-volume[88747]: WARNING amqp [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 05 05:00:13 devstack cinder-volume[88530]: INFO oslo_service.backend._eventlet.service [None req-df805d1e-8d0c-4d4e-8fc9-1a914298eae8 None None] Child 88747 exited with status 0 Sep 05 05:00:14 devstack cinder-volume[89033]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 05 05:00:14 devstack cinder-volume[89033]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 05 05:00:14 devstack cinder-volume[89033]: we strongly recommend against using it for new projects. Sep 05 05:00:14 devstack cinder-volume[89033]: If you are already using Eventlet, we recommend migrating to a different Sep 05 05:00:14 devstack cinder-volume[89033]: framework. For more detail see Sep 05 05:00:14 devstack cinder-volume[89033]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 05 05:00:14 devstack cinder-volume[89033]: import eventlet # noqa Sep 05 05:00:17 devstack cinder-volume[89033]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=89033) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 05:00:17 devstack cinder-volume[89033]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=89033) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 05:00:17 devstack cinder-volume[89033]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=89033) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 05:00:17 devstack cinder-volume[89033]: INFO dbcounter [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] Registered counter for database cinder Sep 05 05:00:17 devstack cinder-volume[89033]: DEBUG oslo_db.sqlalchemy.engines [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89033) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG dbcounter [-] [89033] Writer thread running {{(pid=89033) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 05:00:18 devstack cinder-volume[89033]: INFO cinder.rpc [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 05 05:00:18 devstack cinder-volume[89033]: INFO cinder.rpc [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_db.sqlalchemy.engines [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89033) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 05:00:18 devstack cinder-volume[89033]: INFO cinder.volume.manager [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] Determined volume DB was empty at startup. Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG cinder.volume.manager [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] Cinder Volume DB check: vol_db_empty=True {{(pid=89033) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 05 05:00:18 devstack cinder-volume[89033]: WARNING stevedore.named [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 05 05:00:18 devstack cinder-volume[89033]: WARNING castellan.key_manager [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 05:00:18 devstack cinder-volume[89033]: WARNING cinder.keymgr.conf_key_mgr [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 05:00:18 devstack cinder-volume[89033]: INFO cinder.volume.manager [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_db.sqlalchemy.engines [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89033) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 05:00:18 devstack cinder-volume[89033]: INFO oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] Starting 1 workers Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] Started child 89331 {{(pid=89033) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] Full set of CONF: {{(pid=89033) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] ******************************************************************************** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] Configuration options gathered from: {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] ================================================================================ {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] allow_availability_zone_fallback = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] allow_compression_on_image_upload = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] allowed_direct_url_schemes = [] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] api_rate_limit = True {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89331]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] auth_strategy = keystone {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_availability_zone = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_host = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_name = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_stats_polling_interval = 60 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backup_api_class = cinder.backup.api.API {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backup_name_template = backup-%s {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backup_use_same_host = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backup_use_temp_snapshot = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] chap_password = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] chap_username = {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cinder_internal_tenant_project_id = c268ecf0b76c40019ddef0e6da15f5d4 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cinder_internal_tenant_user_id = 980201c4fe57468c95df93628f3ca296 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cluster = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] compression_format = gzip {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] compute_api_class = cinder.compute.nova.API {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] config_dir = [] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] config_source = [] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] control_exchange = openstack {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] debug = True {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] default_availability_zone = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] default_group_type = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] default_volume_type = QuobyteHD {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] disk_geometry = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] driver_client_cert = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] driver_client_cert_key = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] driver_data_namespace = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] driver_ssl_cert_path = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] driver_ssl_cert_verify = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] driver_use_ssl = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] enable_new_services = True {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] enable_unsupported_driver = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] enabled_backends = ['QuobyteHD'] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] enforce_multipath_for_image_xfer = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] filter_function = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] glance_api_insecure = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] glance_api_servers = ['http://192.168.122.128/image'] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] glance_api_ssl_compression = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] glance_ca_certificates_file = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] glance_catalog_info = image:glance:publicURL {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] glance_certfile = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] glance_keyfile = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] glance_num_retries = 3 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] glance_request_timeout = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] goodness_function = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] graceful_shutdown_timeout = 5 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] group_api_class = cinder.group.api.API {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] host = devstack {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] image_compress_on_upload = True {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] image_conversion_address_space_limit = 1 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] image_conversion_cpu_limit = 60 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] image_conversion_disable = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] image_upload_use_cinder_backend = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] image_upload_use_internal_tenant = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] image_volume_cache_enabled = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] image_volume_cache_max_count = 0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] image_volume_cache_max_size_gb = 0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] init_host_max_objects_retrieval = 0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] instance_format = [instance: %(uuid)s] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] iscsi_target_flags = {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] iscsi_write_cache = on {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] iser_helper = tgtadm {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] iser_ip_address = 192.168.122.128 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] iser_port = 3260 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] log_color = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] log_config_append = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] log_dir = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] log_file = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] log_options = True {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] log_rotate_interval = 1 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] log_rotate_interval_type = days {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] log_rotation_type = none {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] max_age = 0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] max_logfile_count = 30 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] max_logfile_size_mb = 200 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] max_over_subscription_ratio = 20.0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] message_reap_interval = 86400 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] message_ttl = 2592000 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] migration_create_volume_timeout_secs = 300 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] monkey_patch = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] monkey_patch_modules = [] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] my_ip = 192.168.122.128 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] no_snapshot_gb_quota = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] num_iser_scan_tries = 3 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] num_shell_tries = 3 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] num_volume_device_scan_tries = 3 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] nvmeof_conn_info_version = 1 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] nvmet_ns_id = 10 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] nvmet_port_id = 1 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] osapi_max_limit = 1000 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] osapi_volume_ext_list = [] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] osapi_volume_listen = 0.0.0.0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] osapi_volume_listen_port = 8776 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] osapi_volume_use_ssl = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] osapi_volume_workers = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] per_volume_size_limit = -1 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=89331) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] periodic_fuzzy_delay = 60 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] periodic_interval = 60 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] project_id_regex = [0-9a-f\-]+ {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] public_endpoint = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] publish_errors = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] quota_backup_gigabytes = 1000 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] quota_backups = 10 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] quota_gigabytes = 1000 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] quota_groups = 10 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] quota_snapshots = 10 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] quota_volumes = 10 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] rate_limit_burst = 0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] rate_limit_except_level = CRITICAL {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] rate_limit_interval = 0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] reinit_driver_count = 3 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] replication_device = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] report_discard_supported = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] report_interval = 120 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] reservation_clean_interval = 86400 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] reservation_expire = 86400 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] reserved_image_namespaces = [] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] reserved_percentage = 0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] rpc_response_timeout = 120 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] run_external_periodic_tasks = True {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] scst_target_driver = iscsi {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] scst_target_iqn_name = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] service_down_time = 720 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] shell_completion = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] snapshot_name_template = snapshot-%s {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] split_loggers = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] state_path = /opt/stack/data/cinder {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] storage_availability_zone = nova {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] storage_protocol = iSCSI {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] syslog_log_facility = LOG_USER {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] target_helper = lioadm {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] target_ip_address = 192.168.122.128 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] target_port = 3260 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] target_protocol = iscsi {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] target_secondary_ip_addresses = [] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] trace_flags = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] transfer_api_class = cinder.transfer.api.API {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] transport_url = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] until_refresh = 0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] use_chap_auth = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] use_default_quota_class = True {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] use_journal = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] use_json = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] use_multipath_for_image_xfer = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] use_stderr = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] use_syslog = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] verify_glance_signatures = enabled {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] volume_api_class = cinder.volume.api.API {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] volume_backend_name = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] volume_clear = zero {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] volume_clear_ionice = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] volume_clear_size = 0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] volume_copy_bps_limit = 0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] volume_dd_blocksize = 1M {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] volume_name_template = volume-%s {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] volume_service_inithost_offload = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] volume_usage_audit_period = month {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] zoning_mode = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_concurrency.disable_process_locking = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] os_brick.lightos_discovery_client_address = localhost {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] os_brick.wait_mpath_device_interval = 1 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.auth_section = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.auth_type = password {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.auth_version = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.cache = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.certfile = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.delay_auth_decision = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.http_connect_timeout = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.include_service_catalog = True {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.insecure = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.interface = public {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.keyfile = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.memcache_password = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.memcache_secret_key = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.memcache_security_strategy = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.memcache_username = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.region_name = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.service_token_roles_required = True {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.service_type = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.token_cache_time = 300 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.128/identity {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.backend = dogpile.cache.null {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.backend_argument = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.backend_expiration_time = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.config_prefix = cache.oslo {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.debug_cache_backend = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.enable_retry_client = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.enable_socket_keepalive = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.enabled = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.expiration_time = 600 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.hashclient_dead_timeout = 60.0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.hashclient_retry_attempts = 2 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.hashclient_retry_timeout = 1.0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.memcache_dead_retry = 300 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.memcache_pool_maxsize = 10 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.memcache_pool_unused_timeout = 60 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.memcache_sasl_enabled = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.memcache_servers = ['localhost:11211'] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.password = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.proxies = [] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.redis_db = 0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.redis_sentinel_service_name = mymaster {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.redis_server = localhost:6379 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.retry_attempts = 2 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.retry_delay = 0.0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.socket_keepalive_count = 1 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.socket_keepalive_idle = 1 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.socket_keepalive_interval = 1 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.socket_timeout = 1.0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.tls_allowed_ciphers = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.tls_cafile = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.tls_certfile = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.tls_enabled = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.tls_keyfile = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cache.username = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] coordination.backend_url = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] database.asyncio_connection = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] database.asyncio_slave_connection = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] database.backend = sqlalchemy {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] database.connection = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] database.connection_debug = 0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] database.connection_parameters = {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] database.connection_recycle_time = 3600 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] database.connection_trace = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] database.db_inc_retry_interval = True {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] database.db_max_retries = 20 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] database.db_max_retry_interval = 10 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] database.db_retry_interval = 1 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] database.max_overflow = 50 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] database.max_pool_size = 5 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] database.max_retries = 10 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] database.mysql_sql_mode = TRADITIONAL {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] database.mysql_wsrep_sync_wait = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] database.pool_timeout = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] database.retry_interval = 10 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] database.slave_connection = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] database.sqlite_synchronous = True {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] database.synchronous_reader = True {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] database.use_db_reconnect = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=89331) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 05 05:00:18 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.quobyte [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 05 05:00:18 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.quobyte [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_metrics.metrics_process_name = {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_tracing.insecure = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] profiler.connection_string = messaging:// {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] profiler.enabled = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] profiler.es_doc_type = notification {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] profiler.es_scroll_size = 10000 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] profiler.es_scroll_time = 2m {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] profiler.filter_error_trace = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] profiler.hmac_keys = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] profiler.sentinel_service_name = mymaster {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] profiler.socket_timeout = 0.1 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] profiler.trace_requests = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] profiler.trace_sqlalchemy = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] profiler_jaeger.process_tags = {} {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] profiler_jaeger.service_name_prefix = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Running cmd (subprocess): mount.quobyte {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] profiler_otlp.service_name_prefix = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_policy.enforce_new_defaults = True {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_policy.policy_default_rule = default {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_policy.policy_file = policy.yaml {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_policy.remote_timeout = 60.0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] privsep_osbrick.capabilities = [21, 2] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] privsep_osbrick.group = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] privsep_osbrick.helper_command = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] privsep_osbrick.log_daemon_traceback = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] privsep_osbrick.thread_pool_size = 4 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] privsep_osbrick.user = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cinder_sys_admin.group = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cinder_sys_admin.helper_command = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] cinder_sys_admin.user = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] service_user.auth_section = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] service_user.auth_type = password {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] service_user.cafile = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] service_user.certfile = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] service_user.collect_timing = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] service_user.insecure = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] service_user.keyfile = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] service_user.send_service_user_token = True {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] service_user.split_loggers = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] service_user.timeout = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] service_user.tls_ciphers = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] service_user.tls_min_version = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] glance.auth_section = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] glance.auth_type = password {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] glance.certfile = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] glance.collect_timing = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] glance.insecure = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] glance.keyfile = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] glance.region_name = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] glance.split_loggers = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] glance.timeout = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] glance.tls_ciphers = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] glance.tls_min_version = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.backend_availability_zone = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.chap_password = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.chap_username = {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.disk_geometry = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.driver_client_cert = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.driver_client_cert_key = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.driver_data_namespace = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.driver_ssl_cert_path = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.driver_use_ssl = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.enable_unsupported_driver = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.extra_capabilities = {} {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.filter_function = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.goodness_function = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.image_volume_cache_enabled = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.iscsi_target_flags = {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.iscsi_write_cache = on {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.iser_helper = tgtadm {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.iser_ip_address = 192.168.122.128 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.iser_port = 3260 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.nas_host = {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.nas_login = admin {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.nas_mount_options = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.nas_password = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.nas_private_key = {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.nas_secure_file_operations = auto {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.nas_share_path = {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.nas_ssh_port = 22 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.nas_volume_prov_type = thin {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.num_shell_tries = 3 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.nvmet_ns_id = 10 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.nvmet_port_id = 1 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.quobyte_client_cfg = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.quobyte_volume_url = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.replication_device = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.report_discard_supported = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.reserved_percentage = 0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.scst_target_driver = iscsi {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.scst_target_iqn_name = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.storage_protocol = iSCSI {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.target_helper = tgtadm {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.target_ip_address = 192.168.122.128 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.target_port = 3260 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.target_protocol = iscsi {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.trace_flags = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.unique_fqdn_network = True {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.use_chap_auth = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.volume_backend_name = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.volume_clear = zero {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.volume_clear_ionice = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.volume_clear_size = 0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_reports.file_event_handler = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_reports.file_event_handler_interval = 1 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_reports.log_dir = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.backend_availability_zone = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.backend_host = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.chap_password = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.chap_username = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.chiscsi_conf = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.disk_geometry = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.driver_client_cert = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.driver_client_cert_key = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.driver_data_namespace = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.driver_use_ssl = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.enable_unsupported_driver = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.extra_capabilities = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.filter_function = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.goodness_function = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.iscsi_target_flags = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.iscsi_write_cache = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.iser_helper = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.iser_ip_address = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.iser_port = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.iser_target_prefix = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.nas_host = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.nas_login = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.nas_mount_options = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.nas_password = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.nas_private_key = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.nas_secure_file_operations = false {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.nas_share_path = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.nas_ssh_port = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.nas_volume_prov_type = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.num_iser_scan_tries = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.num_shell_tries = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.nvmet_ns_id = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.nvmet_port_id = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.replication_device = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.report_discard_supported = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.reserved_percentage = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.scst_target_driver = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.scst_target_iqn_name = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.storage_protocol = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.target_helper = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.target_ip_address = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.target_port = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.target_prefix = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.target_protocol = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.trace_flags = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.unique_fqdn_network = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.use_chap_auth = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack quobyte-client[89332]: Reading configuration file: /etc/quobyte/client.cfg Sep 05 05:00:18 devstack quobyte-client[89332]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.volume_clear = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.volume_clear_ionice = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.volume_clear_size = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.volume_dd_blocksize = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] QuobyteHD.volumes_dir = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] CMD "mount.quobyte" returned: 1 in 0.088s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.hostname = devstack {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.ssl = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.ssl_version = {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_notifications.driver = [] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_notifications.retry = -1 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] oslo_messaging_notifications.transport_url = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] key_manager.fixed_key = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:00:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:00:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican.barbican_api_version = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican.barbican_endpoint = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican.barbican_endpoint_type = public {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican.barbican_region_name = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican.cafile = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican.certfile = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican.collect_timing = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican.insecure = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican.keyfile = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican.number_of_retries = 60 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican.retry_delay = 1 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican.send_service_user_token = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican.split_loggers = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican.timeout = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican.tls_ciphers = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican.tls_min_version = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican.verify_ssl = True {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican.verify_ssl_path = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican_service_user.auth_section = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican_service_user.auth_type = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican_service_user.cafile = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican_service_user.certfile = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican_service_user.collect_timing = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican_service_user.insecure = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican_service_user.keyfile = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican_service_user.split_loggers = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican_service_user.timeout = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican_service_user.tls_ciphers = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] barbican_service_user.tls_min_version = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] vault.approle_role_id = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] vault.approle_secret_id = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] vault.auth_method = approle {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] vault.auth_path = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] vault.kv_mountpoint = secret {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] vault.kv_path = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] vault.kv_version = 2 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] vault.namespace = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] vault.root_token_id = **** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] vault.ssl_ca_crt_file = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] vault.timeout = 60.0 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] vault.token_file = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] vault.token_role = None {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] vault.use_ssl = False {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 05:00:18 devstack cinder-volume[89033]: DEBUG oslo_service.backend._eventlet.service [None req-4231c800-2a13-4b2d-8292-a43da35569ed None None] ******************************************************************************** {{(pid=89033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 05 05:00:18 devstack sudo[89335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:00:18 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:18 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.236s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:18 devstack cinder-volume[89331]: INFO cinder.volume.driver [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Driver hasn't implemented _init_vendor_properties() Sep 05 05:00:18 devstack cinder-volume[89331]: DEBUG cinder.volume.driver [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6874046325684, 'free_capacity_gb': 1773.6874046325684, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89331) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 05 05:00:18 devstack cinder-volume[89331]: DEBUG oslo_db.sqlalchemy.engines [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89331) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 05:00:18 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writer thread running {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 05:00:18 devstack cinder-volume[89331]: DEBUG cinder.db.api [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Building query based on filter {{(pid=89331) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 05 05:00:18 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=89331) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 05 05:00:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:00:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:00:18 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:00:18 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:00:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:00:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:18 devstack cinder-volume[89331]: INFO cinder.keymgr.migration [None req-aa08ae93-71dd-40ea-a5b2-bf6417d16db6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 05 05:00:19 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:00:19 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:19 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.241s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:19 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:00:19 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Driver initialization completed successfully. Sep 05 05:00:19 devstack cinder-volume[89331]: INFO cinder.manager [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Initiating service 3 cleanup Sep 05 05:00:19 devstack cinder-volume[89331]: INFO cinder.manager [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Service 3 cleanup completed. Sep 05 05:00:19 devstack cinder-volume[89331]: DEBUG cinder.service [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Creating RPC server for service cinder-volume {{(pid=89331) start /opt/stack/cinder/cinder/service.py:231}} Sep 05 05:00:19 devstack cinder-volume[89331]: DEBUG cinder.service [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=89331) start /opt/stack/cinder/cinder/service.py:237}} Sep 05 05:00:19 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 05 05:00:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:00:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:00:19 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:00:19 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:00:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:00:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:19 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:00:19 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:19 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.236s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:19 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-2f7fd02e-a3e9-4bdb-94f4-79670e5bd8c4 None None] Driver post RPC initialization completed successfully. Sep 05 05:00:28 devstack cinder-volume[89033]: DEBUG dbcounter [-] [89033] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=89033) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:00:29 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=2 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:00:29 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:00:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager._thread_info {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:00:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread count: 6 {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 05:00:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread info: [<_MainThread(MainThread, started 139182109970560)>, , , , , ] {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 05:01:17 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:01:17 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Flow 'volume_create_manager' (e6350f84-a695-4baa-90ad-9da57c269e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:01:17 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db73b61-7c10-4c80-b61c-1998ceaaac94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:01:17 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db73b61-7c10-4c80-b61c-1998ceaaac94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1810412817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159f108b-054e-4eef-aaf1-656a1e431ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da96fdeb6c0d42cf8af60ee5f170a015',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:01:18Z,use_quota=True,user_id='bec34534e35f4b8986e20fc8908687cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:01:17 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3166ccb7-9c17-4a2d-ba8e-518c85982206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:01:17 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3166ccb7-9c17-4a2d-ba8e-518c85982206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:01:17 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df00cd1-6d2a-41f4-a9b8-a7b0c167e4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:01:17 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df00cd1-6d2a-41f4-a9b8-a7b0c167e4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '159f108b-054e-4eef-aaf1-656a1e431ab8', 'volume_name': 'volume-159f108b-054e-4eef-aaf1-656a1e431ab8', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:01:17 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a67d542f-c80c-4df4-8f4d-7ff8ee448102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:01:17 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a67d542f-c80c-4df4-8f4d-7ff8ee448102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:01:17 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74bbbc5a-a3de-4a2f-ae1a-bda6d5f3555c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:01:17 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Volume 159f108b-054e-4eef-aaf1-656a1e431ab8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-159f108b-054e-4eef-aaf1-656a1e431ab8', 'volume_size': 1} Sep 05 05:01:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:01:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:01:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1810412817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159f108b-054e-4eef-aaf1-656a1e431ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da96fdeb6c0d42cf8af60ee5f170a015',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:01:18Z,use_quota=True,user_id='bec34534e35f4b8986e20fc8908687cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:01:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Creating volume 159f108b-054e-4eef-aaf1-656a1e431ab8 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:01:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:01:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:01:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:01:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:01:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:01:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:01:17 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:01:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-159f108b-054e-4eef-aaf1-656a1e431ab8 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:01:17 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-159f108b-054e-4eef-aaf1-656a1e431ab8 1073741824 Sep 05 05:01:17 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:01:18 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Sep 05 05:01:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-159f108b-054e-4eef-aaf1-656a1e431ab8 1073741824" returned: 0 in 1.008s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:01:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-159f108b-054e-4eef-aaf1-656a1e431ab8 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:01:19 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-159f108b-054e-4eef-aaf1-656a1e431ab8 Sep 05 05:01:19 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:01:19 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Sep 05 05:01:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-159f108b-054e-4eef-aaf1-656a1e431ab8" returned: 0 in 0.353s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:01:19 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:01:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:01:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74bbbc5a-a3de-4a2f-ae1a-bda6d5f3555c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-159f108b-054e-4eef-aaf1-656a1e431ab8', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:01:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab00d18-3743-4b30-9d7d-b35dc2774a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:01:19 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Volume volume-159f108b-054e-4eef-aaf1-656a1e431ab8 (159f108b-054e-4eef-aaf1-656a1e431ab8): created successfully Sep 05 05:01:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab00d18-3743-4b30-9d7d-b35dc2774a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:01:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Flow 'volume_create_manager' (e6350f84-a695-4baa-90ad-9da57c269e2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:01:19 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-6a01bca0-f61e-4f7e-8f34-8ff66d17578b tempest-TaggedAttachmentsTest-1616369165 None] Created volume successfully. Sep 05 05:01:24 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:01:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Flow 'volume_create_manager' (232b15c2-58cc-419a-b143-552317051ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:01:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41012e13-7cde-4dcc-aeca-9c9c8af78f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:01:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41012e13-7cde-4dcc-aeca-9c9c8af78f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-874864526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3482e6c3-0338-483b-82d1-be05ef62e495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bb7b045f8844efbb368ff3ce36d2a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:01:24Z,use_quota=True,user_id='5a62492a42e743c382457700b47fc986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:01:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44b7cd3-7288-4d65-bc36-351543143bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:01:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44b7cd3-7288-4d65-bc36-351543143bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:01:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a2ea35-62a5-408e-a4dc-0a985c3af8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:01:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a2ea35-62a5-408e-a4dc-0a985c3af8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3482e6c3-0338-483b-82d1-be05ef62e495', 'volume_name': 'volume-3482e6c3-0338-483b-82d1-be05ef62e495', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:01:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e09669f8-9c99-4026-b050-1682bc5bfd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:01:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e09669f8-9c99-4026-b050-1682bc5bfd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:01:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ec6e87-bff4-41ac-8707-5ed0afc6ece7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:01:24 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Volume 3482e6c3-0338-483b-82d1-be05ef62e495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3482e6c3-0338-483b-82d1-be05ef62e495', 'volume_size': 1} Sep 05 05:01:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:01:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:01:24 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-874864526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3482e6c3-0338-483b-82d1-be05ef62e495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bb7b045f8844efbb368ff3ce36d2a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:01:24Z,use_quota=True,user_id='5a62492a42e743c382457700b47fc986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:01:24 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Creating volume 3482e6c3-0338-483b-82d1-be05ef62e495 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:01:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:01:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:01:24 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:01:24 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:01:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:01:24 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:01:24 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:01:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3482e6c3-0338-483b-82d1-be05ef62e495 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:01:24 devstack sudo[90287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3482e6c3-0338-483b-82d1-be05ef62e495 1073741824 Sep 05 05:01:24 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:01:26 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root Sep 05 05:01:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3482e6c3-0338-483b-82d1-be05ef62e495 1073741824" returned: 0 in 1.153s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:01:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3482e6c3-0338-483b-82d1-be05ef62e495 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:01:26 devstack sudo[90326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3482e6c3-0338-483b-82d1-be05ef62e495 Sep 05 05:01:26 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:01:26 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root Sep 05 05:01:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3482e6c3-0338-483b-82d1-be05ef62e495" returned: 0 in 0.645s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:01:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:01:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:01:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ec6e87-bff4-41ac-8707-5ed0afc6ece7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3482e6c3-0338-483b-82d1-be05ef62e495', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:01:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc71e11-8413-4af3-9115-56d0888acafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:01:26 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Volume volume-3482e6c3-0338-483b-82d1-be05ef62e495 (3482e6c3-0338-483b-82d1-be05ef62e495): created successfully Sep 05 05:01:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc71e11-8413-4af3-9115-56d0888acafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:01:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Flow 'volume_create_manager' (232b15c2-58cc-419a-b143-552317051ac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:01:26 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-7d05af80-6de9-4d16-8e9b-f7962c81d8ea tempest-DeleteServersTestJSON-1866359259 None] Created volume successfully. Sep 05 05:01:33 devstack cinder-volume[89331]: WARNING py.warnings [req-5aee8b6a-0d73-443e-ab8c-01d1904953ed req-a3085d86-5f69-41ad-8520-faa33386ccba tempest-DeleteServersTestJSON-1866359259 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 05 05:01:33 devstack cinder-volume[89331]: .first() Sep 05 05:01:33 devstack cinder-volume[89331]: Sep 05 05:01:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-5aee8b6a-0d73-443e-ab8c-01d1904953ed req-a3085d86-5f69-41ad-8520-faa33386ccba tempest-DeleteServersTestJSON-1866359259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:01:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-5aee8b6a-0d73-443e-ab8c-01d1904953ed req-a3085d86-5f69-41ad-8520-faa33386ccba tempest-DeleteServersTestJSON-1866359259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:01:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-5aee8b6a-0d73-443e-ab8c-01d1904953ed req-a3085d86-5f69-41ad-8520-faa33386ccba tempest-DeleteServersTestJSON-1866359259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:01:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-5aee8b6a-0d73-443e-ab8c-01d1904953ed req-a3085d86-5f69-41ad-8520-faa33386ccba tempest-DeleteServersTestJSON-1866359259 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136', 'name': 'volume-3482e6c3-0338-483b-82d1-be05ef62e495', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '69183ff2-5028-4fa0-a864-581a8874aa81', 'enforce_multipath': True} {{(pid=89331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 05:01:33 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-5aee8b6a-0d73-443e-ab8c-01d1904953ed req-a3085d86-5f69-41ad-8520-faa33386ccba tempest-DeleteServersTestJSON-1866359259 None] attachment_update completed successfully. Sep 05 05:01:39 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-5182fe1c-f9a3-4457-8fac-7dfb785e08b7 req-cd73b5e9-83a4-41f5-8d0d-c120866ada56 tempest-DeleteServersTestJSON-1866359259 None] Terminate volume connection completed successfully. Sep 05 05:01:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-5182fe1c-f9a3-4457-8fac-7dfb785e08b7 req-cd73b5e9-83a4-41f5-8d0d-c120866ada56 tempest-DeleteServersTestJSON-1866359259 None] Deleting attachment 69183ff2-5028-4fa0-a864-581a8874aa81. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:01:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] Acquiring lock "cinder-3482e6c3-0338-483b-82d1-be05ef62e495-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:01:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] Lock "cinder-3482e6c3-0338-483b-82d1-be05ef62e495-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:01:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] Acquiring lock "cinder-quobyte-3482e6c3-0338-483b-82d1-be05ef62e495" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:01:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] Lock "cinder-quobyte-3482e6c3-0338-483b-82d1-be05ef62e495" acquired by "delete_volume" :: waited 0.027s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:01:41 devstack cinder-volume[89331]: INFO oslo.privsep.daemon [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpjdfa5w74/privsep.sock'] Sep 05 05:01:41 devstack sudo[90961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpjdfa5w74/privsep.sock Sep 05 05:01:41 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:01:42 devstack cinder-volume[89331]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 05 05:01:42 devstack cinder-volume[89331]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 05 05:01:42 devstack cinder-volume[89331]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 05 05:01:42 devstack cinder-volume[89331]: WARNING oslo.privsep.daemon [-] privsep log: Sep 05 05:01:42 devstack cinder-volume[89331]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 05 05:01:42 devstack cinder-volume[89331]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 05 05:01:42 devstack cinder-volume[89331]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 05 05:01:42 devstack cinder-volume[89331]: WARNING oslo.privsep.daemon [-] privsep log: Sep 05 05:01:42 devstack cinder-volume[89331]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 05 05:01:42 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root Sep 05 05:01:42 devstack cinder-volume[89331]: INFO oslo.privsep.daemon [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] Spawned new privsep daemon via rootwrap Sep 05 05:01:42 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] Accepted privsep connection to /tmp/tmpjdfa5w74/privsep.sock {{(pid=89331) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 05 05:01:42 devstack cinder-volume[89331]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 05 05:01:42 devstack cinder-volume[89331]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 05 05:01:42 devstack cinder-volume[89331]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 05 05:01:42 devstack cinder-volume[89331]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90987 Sep 05 05:01:42 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e42a6fa-6f24-4dc1-9241-b83320e6f373]: (2,) {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:01:42 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[3670ae1c-f55b-48e8-b227-27474ba4e09d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:01:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3482e6c3-0338-483b-82d1-be05ef62e495 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:01:43 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3482e6c3-0338-483b-82d1-be05ef62e495 Sep 05 05:01:43 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:01:43 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Sep 05 05:01:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3482e6c3-0338-483b-82d1-be05ef62e495" returned: 0 in 0.416s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:01:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3482e6c3-0338-483b-82d1-be05ef62e495 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:01:43 devstack sudo[90998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3482e6c3-0338-483b-82d1-be05ef62e495 Sep 05 05:01:43 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:01:43 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root Sep 05 05:01:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3482e6c3-0338-483b-82d1-be05ef62e495" returned: 0 in 0.315s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:01:43 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] Lock "cinder-quobyte-3482e6c3-0338-483b-82d1-be05ef62e495" released by "delete_volume" :: held 2.160s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:01:43 devstack cinder-volume[89331]: WARNING cinder.quota [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:01:43 devstack cinder-volume[89331]: WARNING cinder.quota [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:01:43 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] Created reservations ['add14ea4-af38-4524-a4a5-f6bfc81e1b43', 'b38e6b56-a780-43b6-b1cf-f4c482b0ce93', '89222e17-6f60-46e6-8686-a40a68d575ee', 'ba700d13-5a5b-4cad-8182-566d0d356ba1'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:01:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:01:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:01:43 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:01:43 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:01:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:01:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:01:43 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:01:43 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:01:44 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Sep 05 05:01:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.294s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:01:44 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:01:44 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] Deleted volume successfully. Sep 05 05:01:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-5ba49380-f1fb-4194-abc0-3d1d9d5daece tempest-DeleteServersTestJSON-1866359259 None] Lock "cinder-3482e6c3-0338-483b-82d1-be05ef62e495-delete_volume" released by "delete_volume" :: held 2.763s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:01:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:01:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:01:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:01:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:01:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:01:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:01:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:01:49 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:01:49 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:01:50 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Sep 05 05:01:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.464s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:01:50 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:01:50 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager._thread_info {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:01:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread count: 8 {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 05:01:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread info: [<_MainThread(MainThread, started 139182109970560)>, , , , , , , ] {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 05:01:51 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:01:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Flow 'volume_create_manager' (5fa42b8d-d6c1-4ff6-83c9-f1d79c8acfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:01:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29af0660-7e22-4da0-b445-c2dda4528294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:01:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29af0660-7e22-4da0-b445-c2dda4528294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-890619412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327b9531f3b6414eb2a7b606df64107a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:01:51Z,use_quota=True,user_id='ecd7d14f4d5349d087fba87f9901db49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:01:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed132ace-9dfd-4ff9-b1cf-0a0d965125b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:01:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed132ace-9dfd-4ff9-b1cf-0a0d965125b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:01:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f07921af-9635-420d-a167-f1701fd247cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:01:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f07921af-9635-420d-a167-f1701fd247cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1', 'volume_name': 'volume-626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:01:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c048153b-e26f-4283-a513-7544406f1f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:01:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c048153b-e26f-4283-a513-7544406f1f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:01:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55459c9-feb7-4ec3-b4eb-c949b2eeedf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:01:51 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Volume 626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1', 'volume_size': 1} Sep 05 05:01:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:01:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:01:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-890619412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327b9531f3b6414eb2a7b606df64107a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:01:51Z,use_quota=True,user_id='ecd7d14f4d5349d087fba87f9901db49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:01:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Creating volume 626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:01:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:01:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:01:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:01:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:01:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:01:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:01:51 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:01:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:01:51 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1 1073741824 Sep 05 05:01:51 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:01:52 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Sep 05 05:01:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1 1073741824" returned: 0 in 0.571s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:01:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:01:52 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1 Sep 05 05:01:52 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:01:52 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Sep 05 05:01:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1" returned: 0 in 0.410s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:01:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:01:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:01:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55459c9-feb7-4ec3-b4eb-c949b2eeedf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:01:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba6d84f0-611e-4992-a543-6d0697954c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:01:52 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Volume volume-626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1 (626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1): created successfully Sep 05 05:01:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba6d84f0-611e-4992-a543-6d0697954c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:01:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Flow 'volume_create_manager' (5fa42b8d-d6c1-4ff6-83c9-f1d79c8acfd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:01:52 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-5bf4e03b-36cc-429b-8a3e-4c2fd551dfbf tempest-AttachVolumeShelveTestJSON-630986385 None] Created volume successfully. Sep 05 05:02:02 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:UPDATE=20,cinder:SELECT=19,cinder:INSERT=5 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:02:02 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=18,cinder:INSERT=2,cinder:UPDATE=17,cinder:DELETE=4 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:02:15 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-06336670-615f-4ddd-96b2-c9b2972a42aa req-51520ce3-3416-4819-8bf1-ec12f71548ad tempest-AttachVolumeShelveTestJSON-630986385 None] No connector for attachment 15cb65d3-a85a-4a7b-8408-0f4f7c5dac47; skipping storage backend terminate_connection call. {{(pid=89331) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 05 05:02:15 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-06336670-615f-4ddd-96b2-c9b2972a42aa req-51520ce3-3416-4819-8bf1-ec12f71548ad tempest-AttachVolumeShelveTestJSON-630986385 None] Deleting attachment 15cb65d3-a85a-4a7b-8408-0f4f7c5dac47. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:02:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-0a3d0838-559a-4204-af0d-8f5e0cffda70 req-112bd875-06c1-42c1-b82d-98990e27a327 tempest-TaggedAttachmentsTest-1616369165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:02:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-0a3d0838-559a-4204-af0d-8f5e0cffda70 req-112bd875-06c1-42c1-b82d-98990e27a327 tempest-TaggedAttachmentsTest-1616369165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:02:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-0a3d0838-559a-4204-af0d-8f5e0cffda70 req-112bd875-06c1-42c1-b82d-98990e27a327 tempest-TaggedAttachmentsTest-1616369165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:02:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-0a3d0838-559a-4204-af0d-8f5e0cffda70 req-112bd875-06c1-42c1-b82d-98990e27a327 tempest-TaggedAttachmentsTest-1616369165 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136', 'name': 'volume-159f108b-054e-4eef-aaf1-656a1e431ab8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88eab848-739c-4a83-8b3a-bbfda3725569', 'enforce_multipath': True} {{(pid=89331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 05:02:19 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-0a3d0838-559a-4204-af0d-8f5e0cffda70 req-112bd875-06c1-42c1-b82d-98990e27a327 tempest-TaggedAttachmentsTest-1616369165 None] attachment_update completed successfully. Sep 05 05:02:24 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-e53e29f2-70e5-4706-b4db-a8ea87647934 req-5b550810-34b1-4a48-8de5-28e08ef50dd5 tempest-TaggedAttachmentsTest-1616369165 None] Terminate volume connection completed successfully. Sep 05 05:02:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-e53e29f2-70e5-4706-b4db-a8ea87647934 req-5b550810-34b1-4a48-8de5-28e08ef50dd5 tempest-TaggedAttachmentsTest-1616369165 None] Deleting attachment 88eab848-739c-4a83-8b3a-bbfda3725569. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:02:29 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=10,cinder:UPDATE=1 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:02:34 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:02:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:02:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:02:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:02:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:02:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:02:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:02:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:02:49 devstack sudo[92159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:02:49 devstack sudo[92159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:02:49 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9a30c9f4-1777-4f2f-a97e-d63fc7dbcc74 tempest-TaggedAttachmentsTest-1616369165 None] Acquiring lock "cinder-159f108b-054e-4eef-aaf1-656a1e431ab8-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:02:49 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9a30c9f4-1777-4f2f-a97e-d63fc7dbcc74 tempest-TaggedAttachmentsTest-1616369165 None] Lock "cinder-159f108b-054e-4eef-aaf1-656a1e431ab8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:02:49 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9a30c9f4-1777-4f2f-a97e-d63fc7dbcc74 tempest-TaggedAttachmentsTest-1616369165 None] Acquiring lock "cinder-quobyte-159f108b-054e-4eef-aaf1-656a1e431ab8" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:02:49 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9a30c9f4-1777-4f2f-a97e-d63fc7dbcc74 tempest-TaggedAttachmentsTest-1616369165 None] Lock "cinder-quobyte-159f108b-054e-4eef-aaf1-656a1e431ab8" acquired by "delete_volume" :: waited 0.049s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:02:50 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91f8899-1983-439e-bec7-e6251cb4f8cd]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:02:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a30c9f4-1777-4f2f-a97e-d63fc7dbcc74 tempest-TaggedAttachmentsTest-1616369165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-159f108b-054e-4eef-aaf1-656a1e431ab8 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:02:50 devstack sudo[92162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-159f108b-054e-4eef-aaf1-656a1e431ab8 Sep 05 05:02:50 devstack sudo[92162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:02:50 devstack sudo[92159]: pam_unix(sudo:session): session closed for user root Sep 05 05:02:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.786s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:02:50 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:02:50 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager._thread_info {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:02:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread count: 8 {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 05:02:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread info: [<_MainThread(MainThread, started 139182109970560)>, , , , , , , ] {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 05:02:50 devstack sudo[92162]: pam_unix(sudo:session): session closed for user root Sep 05 05:02:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a30c9f4-1777-4f2f-a97e-d63fc7dbcc74 tempest-TaggedAttachmentsTest-1616369165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-159f108b-054e-4eef-aaf1-656a1e431ab8" returned: 0 in 0.630s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:02:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a30c9f4-1777-4f2f-a97e-d63fc7dbcc74 tempest-TaggedAttachmentsTest-1616369165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-159f108b-054e-4eef-aaf1-656a1e431ab8 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:02:50 devstack sudo[92168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-159f108b-054e-4eef-aaf1-656a1e431ab8 Sep 05 05:02:50 devstack sudo[92168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:02:50 devstack sudo[92168]: pam_unix(sudo:session): session closed for user root Sep 05 05:02:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a30c9f4-1777-4f2f-a97e-d63fc7dbcc74 tempest-TaggedAttachmentsTest-1616369165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-159f108b-054e-4eef-aaf1-656a1e431ab8" returned: 0 in 0.329s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:02:50 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9a30c9f4-1777-4f2f-a97e-d63fc7dbcc74 tempest-TaggedAttachmentsTest-1616369165 None] Lock "cinder-quobyte-159f108b-054e-4eef-aaf1-656a1e431ab8" released by "delete_volume" :: held 1.071s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:02:51 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-9a30c9f4-1777-4f2f-a97e-d63fc7dbcc74 tempest-TaggedAttachmentsTest-1616369165 None] Created reservations ['cdcd4df8-0d20-4eec-bd46-219e99416699', 'fd7e51e5-c6b3-40c6-9fae-f8b01a193d17', '6eb8495a-886e-45b9-9e94-40faa025dcb8', '59550c38-f3bb-4fe1-b83b-04a1c7c91995'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:02:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9a30c9f4-1777-4f2f-a97e-d63fc7dbcc74 tempest-TaggedAttachmentsTest-1616369165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:02:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9a30c9f4-1777-4f2f-a97e-d63fc7dbcc74 tempest-TaggedAttachmentsTest-1616369165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:02:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9a30c9f4-1777-4f2f-a97e-d63fc7dbcc74 tempest-TaggedAttachmentsTest-1616369165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:02:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9a30c9f4-1777-4f2f-a97e-d63fc7dbcc74 tempest-TaggedAttachmentsTest-1616369165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:02:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9a30c9f4-1777-4f2f-a97e-d63fc7dbcc74 tempest-TaggedAttachmentsTest-1616369165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:02:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a30c9f4-1777-4f2f-a97e-d63fc7dbcc74 tempest-TaggedAttachmentsTest-1616369165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:02:51 devstack sudo[92171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:02:51 devstack sudo[92171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:02:51 devstack sudo[92171]: pam_unix(sudo:session): session closed for user root Sep 05 05:02:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a30c9f4-1777-4f2f-a97e-d63fc7dbcc74 tempest-TaggedAttachmentsTest-1616369165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.322s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:02:51 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-9a30c9f4-1777-4f2f-a97e-d63fc7dbcc74 tempest-TaggedAttachmentsTest-1616369165 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:02:51 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-9a30c9f4-1777-4f2f-a97e-d63fc7dbcc74 tempest-TaggedAttachmentsTest-1616369165 None] Deleted volume successfully. Sep 05 05:02:51 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9a30c9f4-1777-4f2f-a97e-d63fc7dbcc74 tempest-TaggedAttachmentsTest-1616369165 None] Lock "cinder-159f108b-054e-4eef-aaf1-656a1e431ab8-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Flow 'volume_create_manager' (878e226e-ce46-4927-aab1-beecb11542bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0594645-da81-42bf-acb0-5939d8ca7d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0594645-da81-42bf-acb0-5939d8ca7d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1656504333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a51e3184-5ce5-40a8-a693-ac5c8c05b8d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c73bfe98d6384b36923436deb10975eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:02:52Z,use_quota=True,user_id='431586ff1ba046c7b26fc134afb118f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faeebe07-a153-4a6e-9a35-277a6cc66e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faeebe07-a153-4a6e-9a35-277a6cc66e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c9eaa4-299a-4cfd-b922-d888f8851899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c9eaa4-299a-4cfd-b922-d888f8851899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a51e3184-5ce5-40a8-a693-ac5c8c05b8d7', 'volume_name': 'volume-a51e3184-5ce5-40a8-a693-ac5c8c05b8d7', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c8c3ca-b930-4984-8f60-e2c351dd0196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c8c3ca-b930-4984-8f60-e2c351dd0196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbc272fc-3721-40fe-8efc-25d163ab2238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:02:52 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Volume a51e3184-5ce5-40a8-a693-ac5c8c05b8d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a51e3184-5ce5-40a8-a693-ac5c8c05b8d7', 'volume_size': 1} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1656504333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a51e3184-5ce5-40a8-a693-ac5c8c05b8d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c73bfe98d6384b36923436deb10975eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:02:52Z,use_quota=True,user_id='431586ff1ba046c7b26fc134afb118f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Creating volume a51e3184-5ce5-40a8-a693-ac5c8c05b8d7 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:02:52 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a51e3184-5ce5-40a8-a693-ac5c8c05b8d7 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:02:52 devstack sudo[92183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a51e3184-5ce5-40a8-a693-ac5c8c05b8d7 1073741824 Sep 05 05:02:52 devstack sudo[92183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Flow 'volume_create_manager' (2a5e7a02-c64d-4902-b761-fe3b7e05dbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e3d14a-abab-4640-bc70-0cf7430cce06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e3d14a-abab-4640-bc70-0cf7430cce06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-763316307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f22229-cf5d-4f3e-92b1-d781ee39f272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e2a02bdee06429e818dbe1d767236b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:02:53Z,use_quota=True,user_id='6a701d7e8a094fc2be05fbedc6e38de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f236ac3-5d8e-4a45-abbb-026e2c17bff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:02:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f236ac3-5d8e-4a45-abbb-026e2c17bff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:02:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87f397f6-13a8-4804-ac62-d1d0222d7964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:02:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87f397f6-13a8-4804-ac62-d1d0222d7964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23f22229-cf5d-4f3e-92b1-d781ee39f272', 'volume_name': 'volume-23f22229-cf5d-4f3e-92b1-d781ee39f272', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:02:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540065fd-61ed-43af-937f-e20ef6c9a3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:02:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540065fd-61ed-43af-937f-e20ef6c9a3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:02:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871d907a-6a03-4d2c-93a7-3961ae80d83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:02:53 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Volume 23f22229-cf5d-4f3e-92b1-d781ee39f272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23f22229-cf5d-4f3e-92b1-d781ee39f272', 'volume_size': 1} Sep 05 05:02:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:02:53 devstack sudo[92183]: pam_unix(sudo:session): session closed for user root Sep 05 05:02:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a51e3184-5ce5-40a8-a693-ac5c8c05b8d7 1073741824" returned: 0 in 0.867s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:02:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a51e3184-5ce5-40a8-a693-ac5c8c05b8d7 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:02:53 devstack sudo[92188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a51e3184-5ce5-40a8-a693-ac5c8c05b8d7 Sep 05 05:02:53 devstack sudo[92188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:02:53 devstack sudo[92188]: pam_unix(sudo:session): session closed for user root Sep 05 05:02:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a51e3184-5ce5-40a8-a693-ac5c8c05b8d7" returned: 0 in 0.616s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:02:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:02:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:02:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.874s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:02:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-763316307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f22229-cf5d-4f3e-92b1-d781ee39f272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e2a02bdee06429e818dbe1d767236b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:02:53Z,use_quota=True,user_id='6a701d7e8a094fc2be05fbedc6e38de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:02:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Creating volume 23f22229-cf5d-4f3e-92b1-d781ee39f272 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:02:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:02:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:02:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:02:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:02:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:02:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:02:53 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:02:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23f22229-cf5d-4f3e-92b1-d781ee39f272 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:02:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbc272fc-3721-40fe-8efc-25d163ab2238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a51e3184-5ce5-40a8-a693-ac5c8c05b8d7', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:02:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ec47f3-42d0-4e09-a379-eba0ecb8f09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:02:53 devstack sudo[92191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23f22229-cf5d-4f3e-92b1-d781ee39f272 1073741824 Sep 05 05:02:53 devstack sudo[92191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:02:54 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Volume volume-a51e3184-5ce5-40a8-a693-ac5c8c05b8d7 (a51e3184-5ce5-40a8-a693-ac5c8c05b8d7): created successfully Sep 05 05:02:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ec47f3-42d0-4e09-a379-eba0ecb8f09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:02:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Flow 'volume_create_manager' (878e226e-ce46-4927-aab1-beecb11542bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:02:54 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-989ff107-559c-44a6-8249-8992f79bae5f tempest-ServerRescueNegativeTestJSON-1583235725 None] Created volume successfully. Sep 05 05:02:54 devstack sudo[92191]: pam_unix(sudo:session): session closed for user root Sep 05 05:02:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23f22229-cf5d-4f3e-92b1-d781ee39f272 1073741824" returned: 0 in 1.051s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:02:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23f22229-cf5d-4f3e-92b1-d781ee39f272 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:02:55 devstack sudo[92198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23f22229-cf5d-4f3e-92b1-d781ee39f272 Sep 05 05:02:55 devstack sudo[92198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:02:55 devstack sudo[92198]: pam_unix(sudo:session): session closed for user root Sep 05 05:02:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23f22229-cf5d-4f3e-92b1-d781ee39f272" returned: 0 in 0.523s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:02:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:02:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:02:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871d907a-6a03-4d2c-93a7-3961ae80d83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23f22229-cf5d-4f3e-92b1-d781ee39f272', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:02:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20854b00-a79d-42bc-bc24-fa2cbdbed291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:02:55 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Volume volume-23f22229-cf5d-4f3e-92b1-d781ee39f272 (23f22229-cf5d-4f3e-92b1-d781ee39f272): created successfully Sep 05 05:02:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20854b00-a79d-42bc-bc24-fa2cbdbed291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:02:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Flow 'volume_create_manager' (2a5e7a02-c64d-4902-b761-fe3b7e05dbef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:02:55 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-85d4c19a-596f-4182-b57c-d68ed516de11 tempest-VolumesAdminNegativeTest-533041941 None] Created volume successfully. Sep 05 05:02:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-892dab80-6f0f-4526-ab1a-d7e3032611fd tempest-VolumesAdminNegativeTest-533041941 None] Acquiring lock "cinder-23f22229-cf5d-4f3e-92b1-d781ee39f272-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:02:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-892dab80-6f0f-4526-ab1a-d7e3032611fd tempest-VolumesAdminNegativeTest-533041941 None] Lock "cinder-23f22229-cf5d-4f3e-92b1-d781ee39f272-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:02:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-892dab80-6f0f-4526-ab1a-d7e3032611fd tempest-VolumesAdminNegativeTest-533041941 None] Acquiring lock "cinder-quobyte-23f22229-cf5d-4f3e-92b1-d781ee39f272" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:02:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-892dab80-6f0f-4526-ab1a-d7e3032611fd tempest-VolumesAdminNegativeTest-533041941 None] Lock "cinder-quobyte-23f22229-cf5d-4f3e-92b1-d781ee39f272" acquired by "delete_volume" :: waited 0.023s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:02:57 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a48c02-c528-46aa-8e55-fd5981d1f9e9]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:02:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-892dab80-6f0f-4526-ab1a-d7e3032611fd tempest-VolumesAdminNegativeTest-533041941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23f22229-cf5d-4f3e-92b1-d781ee39f272 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:02:57 devstack sudo[92213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23f22229-cf5d-4f3e-92b1-d781ee39f272 Sep 05 05:02:57 devstack sudo[92213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:02:58 devstack sudo[92213]: pam_unix(sudo:session): session closed for user root Sep 05 05:02:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-892dab80-6f0f-4526-ab1a-d7e3032611fd tempest-VolumesAdminNegativeTest-533041941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23f22229-cf5d-4f3e-92b1-d781ee39f272" returned: 0 in 0.715s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:02:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-892dab80-6f0f-4526-ab1a-d7e3032611fd tempest-VolumesAdminNegativeTest-533041941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23f22229-cf5d-4f3e-92b1-d781ee39f272 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:02:58 devstack sudo[92232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23f22229-cf5d-4f3e-92b1-d781ee39f272 Sep 05 05:02:58 devstack sudo[92232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:02:58 devstack sudo[92232]: pam_unix(sudo:session): session closed for user root Sep 05 05:02:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-892dab80-6f0f-4526-ab1a-d7e3032611fd tempest-VolumesAdminNegativeTest-533041941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23f22229-cf5d-4f3e-92b1-d781ee39f272" returned: 0 in 0.374s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:02:58 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-892dab80-6f0f-4526-ab1a-d7e3032611fd tempest-VolumesAdminNegativeTest-533041941 None] Lock "cinder-quobyte-23f22229-cf5d-4f3e-92b1-d781ee39f272" released by "delete_volume" :: held 1.164s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:02:58 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-892dab80-6f0f-4526-ab1a-d7e3032611fd tempest-VolumesAdminNegativeTest-533041941 None] Created reservations ['251b8329-19dc-48ab-9649-64fc30c02f00', '33f9550b-6622-4295-acf8-205efbb31023', 'fb741085-1693-4731-83e7-2725b799acf6', 'f091cca9-a8c8-40fa-82f0-39fa509e8f6b'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:02:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-892dab80-6f0f-4526-ab1a-d7e3032611fd tempest-VolumesAdminNegativeTest-533041941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:02:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-892dab80-6f0f-4526-ab1a-d7e3032611fd tempest-VolumesAdminNegativeTest-533041941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:02:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-892dab80-6f0f-4526-ab1a-d7e3032611fd tempest-VolumesAdminNegativeTest-533041941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:02:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-892dab80-6f0f-4526-ab1a-d7e3032611fd tempest-VolumesAdminNegativeTest-533041941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:02:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-892dab80-6f0f-4526-ab1a-d7e3032611fd tempest-VolumesAdminNegativeTest-533041941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:02:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-892dab80-6f0f-4526-ab1a-d7e3032611fd tempest-VolumesAdminNegativeTest-533041941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:02:59 devstack sudo[92246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:02:59 devstack sudo[92246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:02:59 devstack sudo[92246]: pam_unix(sudo:session): session closed for user root Sep 05 05:02:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-892dab80-6f0f-4526-ab1a-d7e3032611fd tempest-VolumesAdminNegativeTest-533041941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.557s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:02:59 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-892dab80-6f0f-4526-ab1a-d7e3032611fd tempest-VolumesAdminNegativeTest-533041941 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:02:59 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-892dab80-6f0f-4526-ab1a-d7e3032611fd tempest-VolumesAdminNegativeTest-533041941 None] Deleted volume successfully. Sep 05 05:02:59 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-892dab80-6f0f-4526-ab1a-d7e3032611fd tempest-VolumesAdminNegativeTest-533041941 None] Lock "cinder-23f22229-cf5d-4f3e-92b1-d781ee39f272-delete_volume" released by "delete_volume" :: held 2.150s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:03:08 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=13,cinder:INSERT=5,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:03:09 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:UPDATE=23,cinder:SELECT=15,cinder:INSERT=5,cinder:DELETE=2 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:03:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3dd8a704-b947-450c-8444-d4b586cc1638 tempest-ServerRescueNegativeTestJSON-1583235725 None] Acquiring lock "cinder-a51e3184-5ce5-40a8-a693-ac5c8c05b8d7-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:03:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3dd8a704-b947-450c-8444-d4b586cc1638 tempest-ServerRescueNegativeTestJSON-1583235725 None] Lock "cinder-a51e3184-5ce5-40a8-a693-ac5c8c05b8d7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:03:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3dd8a704-b947-450c-8444-d4b586cc1638 tempest-ServerRescueNegativeTestJSON-1583235725 None] Acquiring lock "cinder-quobyte-a51e3184-5ce5-40a8-a693-ac5c8c05b8d7" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:03:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3dd8a704-b947-450c-8444-d4b586cc1638 tempest-ServerRescueNegativeTestJSON-1583235725 None] Lock "cinder-quobyte-a51e3184-5ce5-40a8-a693-ac5c8c05b8d7" acquired by "delete_volume" :: waited 0.024s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:03:10 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd84b05-9eeb-4347-94a8-fe2d4bfa6b4a]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:03:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3dd8a704-b947-450c-8444-d4b586cc1638 tempest-ServerRescueNegativeTestJSON-1583235725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a51e3184-5ce5-40a8-a693-ac5c8c05b8d7 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:03:10 devstack sudo[92341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a51e3184-5ce5-40a8-a693-ac5c8c05b8d7 Sep 05 05:03:10 devstack sudo[92341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:03:10 devstack sudo[92341]: pam_unix(sudo:session): session closed for user root Sep 05 05:03:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3dd8a704-b947-450c-8444-d4b586cc1638 tempest-ServerRescueNegativeTestJSON-1583235725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a51e3184-5ce5-40a8-a693-ac5c8c05b8d7" returned: 0 in 0.446s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:03:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3dd8a704-b947-450c-8444-d4b586cc1638 tempest-ServerRescueNegativeTestJSON-1583235725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a51e3184-5ce5-40a8-a693-ac5c8c05b8d7 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:03:10 devstack sudo[92346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a51e3184-5ce5-40a8-a693-ac5c8c05b8d7 Sep 05 05:03:10 devstack sudo[92346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:03:11 devstack sudo[92346]: pam_unix(sudo:session): session closed for user root Sep 05 05:03:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3dd8a704-b947-450c-8444-d4b586cc1638 tempest-ServerRescueNegativeTestJSON-1583235725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a51e3184-5ce5-40a8-a693-ac5c8c05b8d7" returned: 0 in 0.291s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:03:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3dd8a704-b947-450c-8444-d4b586cc1638 tempest-ServerRescueNegativeTestJSON-1583235725 None] Lock "cinder-quobyte-a51e3184-5ce5-40a8-a693-ac5c8c05b8d7" released by "delete_volume" :: held 0.803s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:03:11 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-3dd8a704-b947-450c-8444-d4b586cc1638 tempest-ServerRescueNegativeTestJSON-1583235725 None] Created reservations ['27afa257-48b5-4ac8-9fb8-f6f209faa3c9', 'd5d714d6-031e-42fe-a2d1-abd9ae78099f', '66e3fd61-543e-44de-98e8-4b9fb9c038ef', '2ab89843-2ad4-4da6-89c1-2a6f021b66ad'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:03:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3dd8a704-b947-450c-8444-d4b586cc1638 tempest-ServerRescueNegativeTestJSON-1583235725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:03:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3dd8a704-b947-450c-8444-d4b586cc1638 tempest-ServerRescueNegativeTestJSON-1583235725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:03:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3dd8a704-b947-450c-8444-d4b586cc1638 tempest-ServerRescueNegativeTestJSON-1583235725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:03:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3dd8a704-b947-450c-8444-d4b586cc1638 tempest-ServerRescueNegativeTestJSON-1583235725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:03:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3dd8a704-b947-450c-8444-d4b586cc1638 tempest-ServerRescueNegativeTestJSON-1583235725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:03:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3dd8a704-b947-450c-8444-d4b586cc1638 tempest-ServerRescueNegativeTestJSON-1583235725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:03:11 devstack sudo[92349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:03:11 devstack sudo[92349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:03:11 devstack sudo[92349]: pam_unix(sudo:session): session closed for user root Sep 05 05:03:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3dd8a704-b947-450c-8444-d4b586cc1638 tempest-ServerRescueNegativeTestJSON-1583235725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.727s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:03:12 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-3dd8a704-b947-450c-8444-d4b586cc1638 tempest-ServerRescueNegativeTestJSON-1583235725 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:03:12 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-3dd8a704-b947-450c-8444-d4b586cc1638 tempest-ServerRescueNegativeTestJSON-1583235725 None] Deleted volume successfully. Sep 05 05:03:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3dd8a704-b947-450c-8444-d4b586cc1638 tempest-ServerRescueNegativeTestJSON-1583235725 None] Lock "cinder-a51e3184-5ce5-40a8-a693-ac5c8c05b8d7-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:03:21 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:UPDATE=12,cinder:SELECT=2,cinder:INSERT=3 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:03:22 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:03:32 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e694eaf8-588a-44ba-bca2-172aa6566107 tempest-AttachVolumeShelveTestJSON-630986385 None] Acquiring lock "cinder-626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:03:32 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e694eaf8-588a-44ba-bca2-172aa6566107 tempest-AttachVolumeShelveTestJSON-630986385 None] Lock "cinder-626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:03:32 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e694eaf8-588a-44ba-bca2-172aa6566107 tempest-AttachVolumeShelveTestJSON-630986385 None] Acquiring lock "cinder-quobyte-626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:03:32 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e694eaf8-588a-44ba-bca2-172aa6566107 tempest-AttachVolumeShelveTestJSON-630986385 None] Lock "cinder-quobyte-626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1" acquired by "delete_volume" :: waited 0.025s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:03:32 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7259302c-cfa0-4e45-828f-44232a6eb761]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:03:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e694eaf8-588a-44ba-bca2-172aa6566107 tempest-AttachVolumeShelveTestJSON-630986385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:03:32 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1 Sep 05 05:03:32 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:03:32 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Sep 05 05:03:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e694eaf8-588a-44ba-bca2-172aa6566107 tempest-AttachVolumeShelveTestJSON-630986385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1" returned: 0 in 0.440s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:03:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e694eaf8-588a-44ba-bca2-172aa6566107 tempest-AttachVolumeShelveTestJSON-630986385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:03:32 devstack sudo[92474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1 Sep 05 05:03:32 devstack sudo[92474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:03:33 devstack sudo[92474]: pam_unix(sudo:session): session closed for user root Sep 05 05:03:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e694eaf8-588a-44ba-bca2-172aa6566107 tempest-AttachVolumeShelveTestJSON-630986385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1" returned: 0 in 0.292s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:03:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e694eaf8-588a-44ba-bca2-172aa6566107 tempest-AttachVolumeShelveTestJSON-630986385 None] Lock "cinder-quobyte-626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1" released by "delete_volume" :: held 0.783s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:03:33 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-e694eaf8-588a-44ba-bca2-172aa6566107 tempest-AttachVolumeShelveTestJSON-630986385 None] Created reservations ['074d1c04-1c73-4a83-8b1a-4b2cd318224c', '8b6deb84-6213-47f5-9aab-87069fddb293', '32057695-0aae-41be-91ba-4ef04143ab9e', 'dfac65ce-5eef-4a9e-8d49-c98114d6679e'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:03:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e694eaf8-588a-44ba-bca2-172aa6566107 tempest-AttachVolumeShelveTestJSON-630986385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:03:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e694eaf8-588a-44ba-bca2-172aa6566107 tempest-AttachVolumeShelveTestJSON-630986385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:03:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e694eaf8-588a-44ba-bca2-172aa6566107 tempest-AttachVolumeShelveTestJSON-630986385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:03:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e694eaf8-588a-44ba-bca2-172aa6566107 tempest-AttachVolumeShelveTestJSON-630986385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:03:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e694eaf8-588a-44ba-bca2-172aa6566107 tempest-AttachVolumeShelveTestJSON-630986385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:03:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e694eaf8-588a-44ba-bca2-172aa6566107 tempest-AttachVolumeShelveTestJSON-630986385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:03:33 devstack sudo[92478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:03:33 devstack sudo[92478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:03:33 devstack sudo[92478]: pam_unix(sudo:session): session closed for user root Sep 05 05:03:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e694eaf8-588a-44ba-bca2-172aa6566107 tempest-AttachVolumeShelveTestJSON-630986385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.328s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:03:33 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-e694eaf8-588a-44ba-bca2-172aa6566107 tempest-AttachVolumeShelveTestJSON-630986385 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:03:33 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-e694eaf8-588a-44ba-bca2-172aa6566107 tempest-AttachVolumeShelveTestJSON-630986385 None] Deleted volume successfully. Sep 05 05:03:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e694eaf8-588a-44ba-bca2-172aa6566107 tempest-AttachVolumeShelveTestJSON-630986385 None] Lock "cinder-626c4e36-bedc-45d3-bbb4-42c6ffe5d3e1-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:03:43 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=6 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:03:43 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:03:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:03:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:03:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:03:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:03:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:03:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:03:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:03:49 devstack sudo[92541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:03:49 devstack sudo[92541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:03:50 devstack sudo[92541]: pam_unix(sudo:session): session closed for user root Sep 05 05:03:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.429s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:03:50 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:03:54 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:03:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Flow 'volume_create_manager' (32c08104-9e16-4e48-8929-063c4d4b897c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:03:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4729d46-3b17-41d5-af9e-786a0f800c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:03:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4729d46-3b17-41d5-af9e-786a0f800c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-875532569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc3cfb34-f254-4fb4-abad-e556d7b49c60,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c49aeaea81754f66958c644bde26b536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:03:54Z,use_quota=True,user_id='134ca490772b40e5a98332925dfc12cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:03:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2fefc9-4cf0-444e-8fbf-864d8c96309d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:03:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2fefc9-4cf0-444e-8fbf-864d8c96309d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:03:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e7b7582-e50b-489a-9589-137c0958fc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:03:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e7b7582-e50b-489a-9589-137c0958fc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc3cfb34-f254-4fb4-abad-e556d7b49c60', 'volume_name': 'volume-fc3cfb34-f254-4fb4-abad-e556d7b49c60', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:03:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f37f8c7-aa6c-44aa-9bfa-200bf4a47e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:03:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f37f8c7-aa6c-44aa-9bfa-200bf4a47e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:03:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90eccf4c-9b8a-43c9-ab65-c969b1934ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:03:54 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Volume fc3cfb34-f254-4fb4-abad-e556d7b49c60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc3cfb34-f254-4fb4-abad-e556d7b49c60', 'volume_size': 1} Sep 05 05:03:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:03:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:03:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-875532569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc3cfb34-f254-4fb4-abad-e556d7b49c60,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c49aeaea81754f66958c644bde26b536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:03:54Z,use_quota=True,user_id='134ca490772b40e5a98332925dfc12cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:03:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Creating volume fc3cfb34-f254-4fb4-abad-e556d7b49c60 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:03:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:03:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:03:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:03:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:03:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:03:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:03:54 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:03:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fc3cfb34-f254-4fb4-abad-e556d7b49c60 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:03:54 devstack sudo[92621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fc3cfb34-f254-4fb4-abad-e556d7b49c60 1073741824 Sep 05 05:03:54 devstack sudo[92621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:03:55 devstack sudo[92621]: pam_unix(sudo:session): session closed for user root Sep 05 05:03:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fc3cfb34-f254-4fb4-abad-e556d7b49c60 1073741824" returned: 0 in 0.832s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:03:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fc3cfb34-f254-4fb4-abad-e556d7b49c60 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:03:55 devstack sudo[92630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fc3cfb34-f254-4fb4-abad-e556d7b49c60 Sep 05 05:03:55 devstack sudo[92630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:03:55 devstack sudo[92630]: pam_unix(sudo:session): session closed for user root Sep 05 05:03:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fc3cfb34-f254-4fb4-abad-e556d7b49c60" returned: 0 in 0.491s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:03:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:03:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:03:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90eccf4c-9b8a-43c9-ab65-c969b1934ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc3cfb34-f254-4fb4-abad-e556d7b49c60', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:03:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b24a8889-acb2-4b24-9d75-25f1660f01de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:03:55 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Volume volume-fc3cfb34-f254-4fb4-abad-e556d7b49c60 (fc3cfb34-f254-4fb4-abad-e556d7b49c60): created successfully Sep 05 05:03:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b24a8889-acb2-4b24-9d75-25f1660f01de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:03:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Flow 'volume_create_manager' (32c08104-9e16-4e48-8929-063c4d4b897c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:03:55 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-69bb8800-9635-4933-a746-ba540350de5a tempest-VolumesTestJSON-1231368665 None] Created volume successfully. Sep 05 05:03:57 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:03:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Flow 'volume_create_manager' (44f33459-64d4-4e4c-959d-13423e5fe28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:03:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac2adfc-852d-4668-835e-70faed27a219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:03:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac2adfc-852d-4668-835e-70faed27a219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-558464978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf99fd29-ab88-4d3f-af47-5118d8e00b7d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c49aeaea81754f66958c644bde26b536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:03:58Z,use_quota=True,user_id='134ca490772b40e5a98332925dfc12cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:03:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ffb2201-0322-4fe2-8408-b0c080f819e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:03:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ffb2201-0322-4fe2-8408-b0c080f819e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:03:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40bbaa2f-f58b-40a0-bfdd-6bf6e63d4c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:03:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40bbaa2f-f58b-40a0-bfdd-6bf6e63d4c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf99fd29-ab88-4d3f-af47-5118d8e00b7d', 'volume_name': 'volume-cf99fd29-ab88-4d3f-af47-5118d8e00b7d', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:03:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f07b07-f35b-4eb5-8bee-b8a616c35b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:03:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f07b07-f35b-4eb5-8bee-b8a616c35b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:03:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c416f0ee-6870-4342-9b90-fc7b23f3b111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:03:57 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Volume cf99fd29-ab88-4d3f-af47-5118d8e00b7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf99fd29-ab88-4d3f-af47-5118d8e00b7d', 'volume_size': 1} Sep 05 05:03:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:03:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:03:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-558464978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf99fd29-ab88-4d3f-af47-5118d8e00b7d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c49aeaea81754f66958c644bde26b536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:03:58Z,use_quota=True,user_id='134ca490772b40e5a98332925dfc12cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:03:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Creating volume cf99fd29-ab88-4d3f-af47-5118d8e00b7d {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:03:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:03:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:03:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:03:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:03:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:03:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:03:57 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:03:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf99fd29-ab88-4d3f-af47-5118d8e00b7d 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:03:57 devstack sudo[92651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf99fd29-ab88-4d3f-af47-5118d8e00b7d 1073741824 Sep 05 05:03:57 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:03:58 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root Sep 05 05:03:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf99fd29-ab88-4d3f-af47-5118d8e00b7d 1073741824" returned: 0 in 0.827s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:03:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf99fd29-ab88-4d3f-af47-5118d8e00b7d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:03:58 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf99fd29-ab88-4d3f-af47-5118d8e00b7d Sep 05 05:03:58 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:03:59 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Sep 05 05:03:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf99fd29-ab88-4d3f-af47-5118d8e00b7d" returned: 0 in 0.418s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:03:59 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:03:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:03:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c416f0ee-6870-4342-9b90-fc7b23f3b111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf99fd29-ab88-4d3f-af47-5118d8e00b7d', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:03:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2320abfc-0af7-4fbf-bf76-1b555596cf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:03:59 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Volume volume-cf99fd29-ab88-4d3f-af47-5118d8e00b7d (cf99fd29-ab88-4d3f-af47-5118d8e00b7d): created successfully Sep 05 05:03:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2320abfc-0af7-4fbf-bf76-1b555596cf2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:03:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Flow 'volume_create_manager' (44f33459-64d4-4e4c-959d-13423e5fe28a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:03:59 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-316a8b0f-2c25-4a6b-a93e-1aabab26d998 tempest-VolumesTestJSON-1231368665 None] Created volume successfully. Sep 05 05:04:00 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:04:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Flow 'volume_create_manager' (a81321a8-487c-45a9-823d-15bd07d4d7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:04:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62220cd8-06e1-49c3-81a8-bd8009caee69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62220cd8-06e1-49c3-81a8-bd8009caee69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-209080938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cf0b52-31e3-400b-ae72-9e657878da31,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c49aeaea81754f66958c644bde26b536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:04:01Z,use_quota=True,user_id='134ca490772b40e5a98332925dfc12cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af4c76b-ed14-4982-84c6-0bd4cc99a368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af4c76b-ed14-4982-84c6-0bd4cc99a368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ec06cb-8a12-4862-ae27-456d17a1d59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ec06cb-8a12-4862-ae27-456d17a1d59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62cf0b52-31e3-400b-ae72-9e657878da31', 'volume_name': 'volume-62cf0b52-31e3-400b-ae72-9e657878da31', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae1a832-9b1b-43dd-9dac-7fbaae6364ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae1a832-9b1b-43dd-9dac-7fbaae6364ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0bf5f07-d6c6-4180-b847-ffa3517b3f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:01 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Volume 62cf0b52-31e3-400b-ae72-9e657878da31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62cf0b52-31e3-400b-ae72-9e657878da31', 'volume_size': 1} Sep 05 05:04:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:04:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:04:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-209080938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cf0b52-31e3-400b-ae72-9e657878da31,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c49aeaea81754f66958c644bde26b536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:04:01Z,use_quota=True,user_id='134ca490772b40e5a98332925dfc12cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:04:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Creating volume 62cf0b52-31e3-400b-ae72-9e657878da31 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:04:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:04:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:04:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:04:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:04:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:04:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:04:01 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:04:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62cf0b52-31e3-400b-ae72-9e657878da31 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:01 devstack sudo[92683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62cf0b52-31e3-400b-ae72-9e657878da31 1073741824 Sep 05 05:04:01 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:01 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62cf0b52-31e3-400b-ae72-9e657878da31 1073741824" returned: 0 in 0.715s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62cf0b52-31e3-400b-ae72-9e657878da31 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:01 devstack sudo[92692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62cf0b52-31e3-400b-ae72-9e657878da31 Sep 05 05:04:01 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:02 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62cf0b52-31e3-400b-ae72-9e657878da31" returned: 0 in 0.465s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:04:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:04:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0bf5f07-d6c6-4180-b847-ffa3517b3f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62cf0b52-31e3-400b-ae72-9e657878da31', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d8ae561-ac6a-4695-a25f-ef0194798a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:02 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Volume volume-62cf0b52-31e3-400b-ae72-9e657878da31 (62cf0b52-31e3-400b-ae72-9e657878da31): created successfully Sep 05 05:04:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d8ae561-ac6a-4695-a25f-ef0194798a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Flow 'volume_create_manager' (a81321a8-487c-45a9-823d-15bd07d4d7e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:04:02 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ebeb1274-ad73-4640-8795-739bb8c18632 tempest-VolumesTestJSON-1231368665 None] Created volume successfully. Sep 05 05:04:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7862cdee-e9ff-4d2b-bc33-83f3f6f70811 tempest-VolumesTestJSON-1231368665 None] Acquiring lock "cinder-62cf0b52-31e3-400b-ae72-9e657878da31-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:04:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7862cdee-e9ff-4d2b-bc33-83f3f6f70811 tempest-VolumesTestJSON-1231368665 None] Lock "cinder-62cf0b52-31e3-400b-ae72-9e657878da31-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:04:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7862cdee-e9ff-4d2b-bc33-83f3f6f70811 tempest-VolumesTestJSON-1231368665 None] Acquiring lock "cinder-quobyte-62cf0b52-31e3-400b-ae72-9e657878da31" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:04:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7862cdee-e9ff-4d2b-bc33-83f3f6f70811 tempest-VolumesTestJSON-1231368665 None] Lock "cinder-quobyte-62cf0b52-31e3-400b-ae72-9e657878da31" acquired by "delete_volume" :: waited 0.036s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:04:06 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ca0d73-af01-4beb-8b6b-35e4d012854e]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:04:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7862cdee-e9ff-4d2b-bc33-83f3f6f70811 tempest-VolumesTestJSON-1231368665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62cf0b52-31e3-400b-ae72-9e657878da31 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:06 devstack sudo[92841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62cf0b52-31e3-400b-ae72-9e657878da31 Sep 05 05:04:06 devstack sudo[92841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:07 devstack sudo[92841]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7862cdee-e9ff-4d2b-bc33-83f3f6f70811 tempest-VolumesTestJSON-1231368665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62cf0b52-31e3-400b-ae72-9e657878da31" returned: 0 in 0.981s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7862cdee-e9ff-4d2b-bc33-83f3f6f70811 tempest-VolumesTestJSON-1231368665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62cf0b52-31e3-400b-ae72-9e657878da31 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:07 devstack sudo[92855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62cf0b52-31e3-400b-ae72-9e657878da31 Sep 05 05:04:07 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:08 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7862cdee-e9ff-4d2b-bc33-83f3f6f70811 tempest-VolumesTestJSON-1231368665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62cf0b52-31e3-400b-ae72-9e657878da31" returned: 0 in 0.398s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7862cdee-e9ff-4d2b-bc33-83f3f6f70811 tempest-VolumesTestJSON-1231368665 None] Lock "cinder-quobyte-62cf0b52-31e3-400b-ae72-9e657878da31" released by "delete_volume" :: held 1.472s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:04:08 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-7862cdee-e9ff-4d2b-bc33-83f3f6f70811 tempest-VolumesTestJSON-1231368665 None] Created reservations ['cb573586-aced-42bb-b4ee-3f8a340006f0', '9ca31097-e1b3-4b45-a271-407424479213', 'e8fdf159-696c-4fa9-a72e-f72b4dc5c771', '7a176509-fede-4096-8d2f-2a9f369b0ee6'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:04:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7862cdee-e9ff-4d2b-bc33-83f3f6f70811 tempest-VolumesTestJSON-1231368665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:04:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7862cdee-e9ff-4d2b-bc33-83f3f6f70811 tempest-VolumesTestJSON-1231368665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:04:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7862cdee-e9ff-4d2b-bc33-83f3f6f70811 tempest-VolumesTestJSON-1231368665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:04:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7862cdee-e9ff-4d2b-bc33-83f3f6f70811 tempest-VolumesTestJSON-1231368665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:04:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7862cdee-e9ff-4d2b-bc33-83f3f6f70811 tempest-VolumesTestJSON-1231368665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:04:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7862cdee-e9ff-4d2b-bc33-83f3f6f70811 tempest-VolumesTestJSON-1231368665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:08 devstack sudo[92858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:04:08 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:08 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7862cdee-e9ff-4d2b-bc33-83f3f6f70811 tempest-VolumesTestJSON-1231368665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.388s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:08 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-7862cdee-e9ff-4d2b-bc33-83f3f6f70811 tempest-VolumesTestJSON-1231368665 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:04:08 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-7862cdee-e9ff-4d2b-bc33-83f3f6f70811 tempest-VolumesTestJSON-1231368665 None] Deleted volume successfully. Sep 05 05:04:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7862cdee-e9ff-4d2b-bc33-83f3f6f70811 tempest-VolumesTestJSON-1231368665 None] Lock "cinder-62cf0b52-31e3-400b-ae72-9e657878da31-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:04:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-788630be-7838-4783-abf5-c76166762665 tempest-VolumesTestJSON-1231368665 None] Acquiring lock "cinder-cf99fd29-ab88-4d3f-af47-5118d8e00b7d-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:04:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-788630be-7838-4783-abf5-c76166762665 tempest-VolumesTestJSON-1231368665 None] Lock "cinder-cf99fd29-ab88-4d3f-af47-5118d8e00b7d-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:04:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-788630be-7838-4783-abf5-c76166762665 tempest-VolumesTestJSON-1231368665 None] Acquiring lock "cinder-quobyte-cf99fd29-ab88-4d3f-af47-5118d8e00b7d" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:04:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-788630be-7838-4783-abf5-c76166762665 tempest-VolumesTestJSON-1231368665 None] Lock "cinder-quobyte-cf99fd29-ab88-4d3f-af47-5118d8e00b7d" acquired by "delete_volume" :: waited 0.040s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:04:09 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e83d46-3f0d-4dd5-a4d6-de9cfafe3c79]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:04:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-788630be-7838-4783-abf5-c76166762665 tempest-VolumesTestJSON-1231368665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf99fd29-ab88-4d3f-af47-5118d8e00b7d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:09 devstack sudo[92863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf99fd29-ab88-4d3f-af47-5118d8e00b7d Sep 05 05:04:09 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:09 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-788630be-7838-4783-abf5-c76166762665 tempest-VolumesTestJSON-1231368665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf99fd29-ab88-4d3f-af47-5118d8e00b7d" returned: 0 in 0.544s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-788630be-7838-4783-abf5-c76166762665 tempest-VolumesTestJSON-1231368665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf99fd29-ab88-4d3f-af47-5118d8e00b7d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:09 devstack sudo[92870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf99fd29-ab88-4d3f-af47-5118d8e00b7d Sep 05 05:04:09 devstack sudo[92870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:10 devstack sudo[92870]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-788630be-7838-4783-abf5-c76166762665 tempest-VolumesTestJSON-1231368665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf99fd29-ab88-4d3f-af47-5118d8e00b7d" returned: 0 in 0.370s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-788630be-7838-4783-abf5-c76166762665 tempest-VolumesTestJSON-1231368665 None] Lock "cinder-quobyte-cf99fd29-ab88-4d3f-af47-5118d8e00b7d" released by "delete_volume" :: held 0.995s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:04:10 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-788630be-7838-4783-abf5-c76166762665 tempest-VolumesTestJSON-1231368665 None] Created reservations ['67015d5f-0612-411e-97ed-4897adf3fd9d', 'b68391f8-750d-440c-b6fa-122216943a33', 'fbc07e0d-1bc1-4adc-a2c3-d05e69104494', '26ee7605-3663-47da-88bc-ba5fd97ec77d'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:04:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-788630be-7838-4783-abf5-c76166762665 tempest-VolumesTestJSON-1231368665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:04:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-788630be-7838-4783-abf5-c76166762665 tempest-VolumesTestJSON-1231368665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:04:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-788630be-7838-4783-abf5-c76166762665 tempest-VolumesTestJSON-1231368665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:04:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-788630be-7838-4783-abf5-c76166762665 tempest-VolumesTestJSON-1231368665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:04:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-788630be-7838-4783-abf5-c76166762665 tempest-VolumesTestJSON-1231368665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:04:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-788630be-7838-4783-abf5-c76166762665 tempest-VolumesTestJSON-1231368665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:10 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:04:10 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:10 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-788630be-7838-4783-abf5-c76166762665 tempest-VolumesTestJSON-1231368665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.347s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:10 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-788630be-7838-4783-abf5-c76166762665 tempest-VolumesTestJSON-1231368665 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:04:10 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-788630be-7838-4783-abf5-c76166762665 tempest-VolumesTestJSON-1231368665 None] Deleted volume successfully. Sep 05 05:04:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-788630be-7838-4783-abf5-c76166762665 tempest-VolumesTestJSON-1231368665 None] Lock "cinder-cf99fd29-ab88-4d3f-af47-5118d8e00b7d-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:04:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-33747042-1a26-4e8a-8225-977083468115 tempest-VolumesTestJSON-1231368665 None] Acquiring lock "cinder-fc3cfb34-f254-4fb4-abad-e556d7b49c60-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:04:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-33747042-1a26-4e8a-8225-977083468115 tempest-VolumesTestJSON-1231368665 None] Lock "cinder-fc3cfb34-f254-4fb4-abad-e556d7b49c60-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:04:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-33747042-1a26-4e8a-8225-977083468115 tempest-VolumesTestJSON-1231368665 None] Acquiring lock "cinder-quobyte-fc3cfb34-f254-4fb4-abad-e556d7b49c60" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:04:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-33747042-1a26-4e8a-8225-977083468115 tempest-VolumesTestJSON-1231368665 None] Lock "cinder-quobyte-fc3cfb34-f254-4fb4-abad-e556d7b49c60" acquired by "delete_volume" :: waited 0.036s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:04:11 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[30068f68-a649-44ed-8644-c29b3272fdf2]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:04:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-33747042-1a26-4e8a-8225-977083468115 tempest-VolumesTestJSON-1231368665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fc3cfb34-f254-4fb4-abad-e556d7b49c60 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:11 devstack sudo[92879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fc3cfb34-f254-4fb4-abad-e556d7b49c60 Sep 05 05:04:11 devstack sudo[92879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:11 devstack sudo[92879]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-33747042-1a26-4e8a-8225-977083468115 tempest-VolumesTestJSON-1231368665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fc3cfb34-f254-4fb4-abad-e556d7b49c60" returned: 0 in 0.437s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-33747042-1a26-4e8a-8225-977083468115 tempest-VolumesTestJSON-1231368665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fc3cfb34-f254-4fb4-abad-e556d7b49c60 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:11 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fc3cfb34-f254-4fb4-abad-e556d7b49c60 Sep 05 05:04:11 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:12 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-33747042-1a26-4e8a-8225-977083468115 tempest-VolumesTestJSON-1231368665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fc3cfb34-f254-4fb4-abad-e556d7b49c60" returned: 0 in 0.257s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-33747042-1a26-4e8a-8225-977083468115 tempest-VolumesTestJSON-1231368665 None] Lock "cinder-quobyte-fc3cfb34-f254-4fb4-abad-e556d7b49c60" released by "delete_volume" :: held 0.753s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:04:12 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-33747042-1a26-4e8a-8225-977083468115 tempest-VolumesTestJSON-1231368665 None] Created reservations ['220b8722-140e-411f-8db9-01cb24c94ccf', '9ff6ac26-3f43-482b-a092-1e4bb14c42ed', '4d109678-7904-4ffa-ba13-a9a879aee21c', '62486bb0-4c29-4a15-b6e1-ba04e22185e9'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:04:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-33747042-1a26-4e8a-8225-977083468115 tempest-VolumesTestJSON-1231368665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:04:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-33747042-1a26-4e8a-8225-977083468115 tempest-VolumesTestJSON-1231368665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:04:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-33747042-1a26-4e8a-8225-977083468115 tempest-VolumesTestJSON-1231368665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:04:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-33747042-1a26-4e8a-8225-977083468115 tempest-VolumesTestJSON-1231368665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:04:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-33747042-1a26-4e8a-8225-977083468115 tempest-VolumesTestJSON-1231368665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:04:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-33747042-1a26-4e8a-8225-977083468115 tempest-VolumesTestJSON-1231368665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:12 devstack sudo[92888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:04:12 devstack sudo[92888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:12 devstack sudo[92888]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-33747042-1a26-4e8a-8225-977083468115 tempest-VolumesTestJSON-1231368665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.323s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:12 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-33747042-1a26-4e8a-8225-977083468115 tempest-VolumesTestJSON-1231368665 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:04:12 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-33747042-1a26-4e8a-8225-977083468115 tempest-VolumesTestJSON-1231368665 None] Deleted volume successfully. Sep 05 05:04:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-33747042-1a26-4e8a-8225-977083468115 tempest-VolumesTestJSON-1231368665 None] Lock "cinder-fc3cfb34-f254-4fb4-abad-e556d7b49c60-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:04:17 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:04:17 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Flow 'volume_create_manager' (a97bf599-d782-42e7-a5d7-b06db086cef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:04:17 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8714b0f9-8458-40d1-972a-1b80fba654b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:17 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8714b0f9-8458-40d1-972a-1b80fba654b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1528464432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499c93e9-5791-4f34-8636-e0db23adfa51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a69f0622a0874d20a86028e75af9fb59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:04:17Z,use_quota=True,user_id='55532b8573ab45f98b984cd26de1bc49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:17 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14591ef8-fdaf-49cb-a51d-94169a36de98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:17 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14591ef8-fdaf-49cb-a51d-94169a36de98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:17 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280de56e-fd87-41a6-bf05-c27c73511d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:17 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280de56e-fd87-41a6-bf05-c27c73511d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '499c93e9-5791-4f34-8636-e0db23adfa51', 'volume_name': 'volume-499c93e9-5791-4f34-8636-e0db23adfa51', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:17 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (411b5a3a-cd26-45f3-aa3f-71c0d45eef5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:17 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (411b5a3a-cd26-45f3-aa3f-71c0d45eef5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:17 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8d70fe-9afe-4045-882b-a63644a72665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:17 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Volume 499c93e9-5791-4f34-8636-e0db23adfa51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-499c93e9-5791-4f34-8636-e0db23adfa51', 'volume_size': 1} Sep 05 05:04:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:04:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:04:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1528464432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499c93e9-5791-4f34-8636-e0db23adfa51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a69f0622a0874d20a86028e75af9fb59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:04:17Z,use_quota=True,user_id='55532b8573ab45f98b984cd26de1bc49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:04:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Creating volume 499c93e9-5791-4f34-8636-e0db23adfa51 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:04:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:04:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:04:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:04:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:04:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:04:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:04:17 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:04:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-499c93e9-5791-4f34-8636-e0db23adfa51 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:17 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-499c93e9-5791-4f34-8636-e0db23adfa51 1073741824 Sep 05 05:04:17 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:18 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-499c93e9-5791-4f34-8636-e0db23adfa51 1073741824" returned: 0 in 0.788s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-499c93e9-5791-4f34-8636-e0db23adfa51 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:18 devstack sudo[92911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-499c93e9-5791-4f34-8636-e0db23adfa51 Sep 05 05:04:18 devstack sudo[92911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:19 devstack sudo[92911]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-499c93e9-5791-4f34-8636-e0db23adfa51" returned: 0 in 0.551s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:19 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:04:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:04:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8d70fe-9afe-4045-882b-a63644a72665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-499c93e9-5791-4f34-8636-e0db23adfa51', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0ce4bd-589f-4e4a-91ca-a4694605ee2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:19 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Volume volume-499c93e9-5791-4f34-8636-e0db23adfa51 (499c93e9-5791-4f34-8636-e0db23adfa51): created successfully Sep 05 05:04:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0ce4bd-589f-4e4a-91ca-a4694605ee2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Flow 'volume_create_manager' (a97bf599-d782-42e7-a5d7-b06db086cef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:04:19 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-225a95ab-b6d5-4117-af82-f00541c25c94 tempest-AttachVolumeTestJSON-200281865 None] Created volume successfully. Sep 05 05:04:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-fa51b180-1085-497b-9c62-66afaa085ebc req-a2f5318c-f9d1-4f17-9da2-7d05f1082649 tempest-AttachVolumeTestJSON-200281865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:04:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-fa51b180-1085-497b-9c62-66afaa085ebc req-a2f5318c-f9d1-4f17-9da2-7d05f1082649 tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:04:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-fa51b180-1085-497b-9c62-66afaa085ebc req-a2f5318c-f9d1-4f17-9da2-7d05f1082649 tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:04:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-fa51b180-1085-497b-9c62-66afaa085ebc req-a2f5318c-f9d1-4f17-9da2-7d05f1082649 tempest-AttachVolumeTestJSON-200281865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136', 'name': 'volume-499c93e9-5791-4f34-8636-e0db23adfa51', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54b0e075-d01c-40ff-a1d4-c82c8fd84b38', 'enforce_multipath': True} {{(pid=89331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 05:04:20 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-fa51b180-1085-497b-9c62-66afaa085ebc req-a2f5318c-f9d1-4f17-9da2-7d05f1082649 tempest-AttachVolumeTestJSON-200281865 None] attachment_update completed successfully. Sep 05 05:04:22 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-88987858-170a-427d-9e3c-4d2464b5c33a tempest-GroupSnapshotsV319Test-126648943 None] Group tempest-GroupSnapshotsV319Test-Group-1860105052: creating Sep 05 05:04:22 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-88987858-170a-427d-9e3c-4d2464b5c33a tempest-GroupSnapshotsV319Test-126648943 None] Group tempest-GroupSnapshotsV319Test-Group-1860105052: created successfully Sep 05 05:04:22 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-88987858-170a-427d-9e3c-4d2464b5c33a tempest-GroupSnapshotsV319Test-126648943 None] Create group completed successfully. Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Flow 'volume_create_manager' (f1862887-fe30-421d-85a2-eb9d40d81544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d126e6bc-a832-4d44-a1f5-2b62dcda9e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d126e6bc-a832-4d44-a1f5-2b62dcda9e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1367993336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=39a0a684-f273-4a04-9625-51f12e7369f6,host='devstack@QuobyteHD#QuobyteHD',id=31a0fb50-191c-4327-97d3-49bb7bb6de77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b730b48123414e9ba761710414a00088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:04:24Z,use_quota=True,user_id='715a3488c5924fbd80bf289231fa081c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fedd21a-d0ce-46bb-b88c-c633e6230613),volume_type_id=5fedd21a-d0ce-46bb-b88c-c633e6230613)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a937995-ad0e-4627-97ec-0bfba6138f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a937995-ad0e-4627-97ec-0bfba6138f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d392b34d-2bf2-4f39-b7ab-a9b63053c673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d392b34d-2bf2-4f39-b7ab-a9b63053c673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31a0fb50-191c-4327-97d3-49bb7bb6de77', 'volume_name': 'volume-31a0fb50-191c-4327-97d3-49bb7bb6de77', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e419d4b-046d-46ea-9b2d-798482fe7684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e419d4b-046d-46ea-9b2d-798482fe7684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1b6428-f8d5-4050-b7a1-3a843ef1fbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:24 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Volume 31a0fb50-191c-4327-97d3-49bb7bb6de77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31a0fb50-191c-4327-97d3-49bb7bb6de77', 'volume_size': 1} Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=39a0a684-f273-4a04-9625-51f12e7369f6,created_at=2026-09-05T03:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1367993336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=39a0a684-f273-4a04-9625-51f12e7369f6,host='devstack@QuobyteHD#QuobyteHD',id=31a0fb50-191c-4327-97d3-49bb7bb6de77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b730b48123414e9ba761710414a00088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:04:24Z,use_quota=True,user_id='715a3488c5924fbd80bf289231fa081c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fedd21a-d0ce-46bb-b88c-c633e6230613),volume_type_id=5fedd21a-d0ce-46bb-b88c-c633e6230613)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Creating volume 31a0fb50-191c-4327-97d3-49bb7bb6de77 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:04:24 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:24 devstack sudo[93402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77 1073741824 Sep 05 05:04:24 devstack sudo[93402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:24 devstack sudo[93402]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77 1073741824" returned: 0 in 0.461s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:24 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77 Sep 05 05:04:24 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:25 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77" returned: 0 in 0.251s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:04:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:04:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1b6428-f8d5-4050-b7a1-3a843ef1fbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31a0fb50-191c-4327-97d3-49bb7bb6de77', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754ff9c4-818c-48e2-828f-58971bb851b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:25 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Volume volume-31a0fb50-191c-4327-97d3-49bb7bb6de77 (31a0fb50-191c-4327-97d3-49bb7bb6de77): created successfully Sep 05 05:04:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754ff9c4-818c-48e2-828f-58971bb851b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Flow 'volume_create_manager' (f1862887-fe30-421d-85a2-eb9d40d81544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:04:25 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-6aa6d396-1fb4-47fb-a50e-90d21302ee16 tempest-GroupSnapshotsV319Test-126648943 None] Created volume successfully. Sep 05 05:04:26 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ab167b60-26dd-4036-8a0a-e57e086e5c7f tempest-GroupSnapshotsV319Test-126648943 None] GroupSnapshot 5e538b6f-4495-4ecc-b5b5-a5ed1c24d066: creating. Sep 05 05:04:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ab167b60-26dd-4036-8a0a-e57e086e5c7f tempest-GroupSnapshotsV319Test-126648943 None] Group snapshot 5e538b6f-4495-4ecc-b5b5-a5ed1c24d066: creating. {{(pid=89331) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 05 05:04:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ab167b60-26dd-4036-8a0a-e57e086e5c7f tempest-GroupSnapshotsV319Test-126648943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:04:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ab167b60-26dd-4036-8a0a-e57e086e5c7f tempest-GroupSnapshotsV319Test-126648943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:04:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-ab167b60-26dd-4036-8a0a-e57e086e5c7f tempest-GroupSnapshotsV319Test-126648943 None] Creating offline snapshot 87bf095b-d3eb-47f1-83be-89b0a5b360a2 of volume 31a0fb50-191c-4327-97d3-49bb7bb6de77 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:04:26 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d0daf8-3999-44dc-b945-c1c9a55b2541]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:04:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab167b60-26dd-4036-8a0a-e57e086e5c7f tempest-GroupSnapshotsV319Test-126648943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:26 devstack sudo[93526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77 Sep 05 05:04:26 devstack sudo[93526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:26 devstack sudo[93526]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab167b60-26dd-4036-8a0a-e57e086e5c7f tempest-GroupSnapshotsV319Test-126648943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77" returned: 0 in 0.439s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab167b60-26dd-4036-8a0a-e57e086e5c7f tempest-GroupSnapshotsV319Test-126648943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.87bf095b-d3eb-47f1-83be-89b0a5b360a2 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:26 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.87bf095b-d3eb-47f1-83be-89b0a5b360a2 1G Sep 05 05:04:26 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:27 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab167b60-26dd-4036-8a0a-e57e086e5c7f tempest-GroupSnapshotsV319Test-126648943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.87bf095b-d3eb-47f1-83be-89b0a5b360a2 1G" returned: 0 in 0.740s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab167b60-26dd-4036-8a0a-e57e086e5c7f tempest-GroupSnapshotsV319Test-126648943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31a0fb50-191c-4327-97d3-49bb7bb6de77 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.87bf095b-d3eb-47f1-83be-89b0a5b360a2 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:27 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31a0fb50-191c-4327-97d3-49bb7bb6de77 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.87bf095b-d3eb-47f1-83be-89b0a5b360a2 Sep 05 05:04:27 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:27 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab167b60-26dd-4036-8a0a-e57e086e5c7f tempest-GroupSnapshotsV319Test-126648943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31a0fb50-191c-4327-97d3-49bb7bb6de77 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.87bf095b-d3eb-47f1-83be-89b0a5b360a2" returned: 0 in 0.466s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:27 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-ab167b60-26dd-4036-8a0a-e57e086e5c7f tempest-GroupSnapshotsV319Test-126648943 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.87bf095b-d3eb-47f1-83be-89b0a5b360a2 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 05:04:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab167b60-26dd-4036-8a0a-e57e086e5c7f tempest-GroupSnapshotsV319Test-126648943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.87bf095b-d3eb-47f1-83be-89b0a5b360a2 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:27 devstack sudo[93930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.87bf095b-d3eb-47f1-83be-89b0a5b360a2 Sep 05 05:04:27 devstack sudo[93930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:28 devstack sudo[93930]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab167b60-26dd-4036-8a0a-e57e086e5c7f tempest-GroupSnapshotsV319Test-126648943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.87bf095b-d3eb-47f1-83be-89b0a5b360a2" returned: 0 in 0.347s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab167b60-26dd-4036-8a0a-e57e086e5c7f tempest-GroupSnapshotsV319Test-126648943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:28 devstack sudo[93937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.info Sep 05 05:04:28 devstack sudo[93937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:28 devstack sudo[93937]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab167b60-26dd-4036-8a0a-e57e086e5c7f tempest-GroupSnapshotsV319Test-126648943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.info" returned: 0 in 0.247s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:28 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-ab167b60-26dd-4036-8a0a-e57e086e5c7f tempest-GroupSnapshotsV319Test-126648943 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 05:04:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab167b60-26dd-4036-8a0a-e57e086e5c7f tempest-GroupSnapshotsV319Test-126648943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:28 devstack sudo[93942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.info Sep 05 05:04:28 devstack sudo[93942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:28 devstack sudo[93942]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab167b60-26dd-4036-8a0a-e57e086e5c7f tempest-GroupSnapshotsV319Test-126648943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.info" returned: 0 in 0.279s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ab167b60-26dd-4036-8a0a-e57e086e5c7f tempest-GroupSnapshotsV319Test-126648943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.638s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:04:28 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ab167b60-26dd-4036-8a0a-e57e086e5c7f tempest-GroupSnapshotsV319Test-126648943 None] group_snapshot 5e538b6f-4495-4ecc-b5b5-a5ed1c24d066: created successfully Sep 05 05:04:30 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ebbe98dd-fef1-4324-92d8-1ec047dd7626 tempest-GroupSnapshotsV319Test-126648943 None] group_snapshot 5e538b6f-4495-4ecc-b5b5-a5ed1c24d066: deleting Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ebbe98dd-fef1-4324-92d8-1ec047dd7626 tempest-GroupSnapshotsV319Test-126648943 None] group_snapshot 5e538b6f-4495-4ecc-b5b5-a5ed1c24d066: deleting {{(pid=89331) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ebbe98dd-fef1-4324-92d8-1ec047dd7626 tempest-GroupSnapshotsV319Test-126648943 None] Acquiring lock "cinder-quobyte-31a0fb50-191c-4327-97d3-49bb7bb6de77" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Flow 'volume_create_manager' (36cfaf77-1861-4a43-9b57-76501b5827c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44d23ef-6454-4f0c-ad2d-cdca4e345848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ebbe98dd-fef1-4324-92d8-1ec047dd7626 tempest-GroupSnapshotsV319Test-126648943 None] Lock "cinder-quobyte-31a0fb50-191c-4327-97d3-49bb7bb6de77" acquired by "delete_snapshot" :: waited 0.064s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ebbe98dd-fef1-4324-92d8-1ec047dd7626 tempest-GroupSnapshotsV319Test-126648943 None] Acquiring lock "cinder-quobyte-87bf095b-d3eb-47f1-83be-89b0a5b360a2" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44d23ef-6454-4f0c-ad2d-cdca4e345848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1040549533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d890488e-c1b6-4060-aed4-caaed3eaca63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16cf223fa3e466096a97a3f568b8094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:04:30Z,use_quota=True,user_id='7210a9b8a9c54e46a15a82e0c7fd829b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce9b030-6574-4649-9633-55e011f994dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce9b030-6574-4649-9633-55e011f994dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a154f60-2b6f-406a-8e30-65703b81bd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a154f60-2b6f-406a-8e30-65703b81bd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd890488e-c1b6-4060-aed4-caaed3eaca63', 'volume_name': 'volume-d890488e-c1b6-4060-aed4-caaed3eaca63', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7d44ad-4543-48e8-910f-dd4cb8a1c57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7d44ad-4543-48e8-910f-dd4cb8a1c57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (affe4e23-eb5a-49e0-8dad-fe357aa0b1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:30 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Volume d890488e-c1b6-4060-aed4-caaed3eaca63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d890488e-c1b6-4060-aed4-caaed3eaca63', 'volume_size': 1} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1040549533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d890488e-c1b6-4060-aed4-caaed3eaca63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16cf223fa3e466096a97a3f568b8094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:04:30Z,use_quota=True,user_id='7210a9b8a9c54e46a15a82e0c7fd829b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Creating volume d890488e-c1b6-4060-aed4-caaed3eaca63 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:04:30 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d890488e-c1b6-4060-aed4-caaed3eaca63 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ebbe98dd-fef1-4324-92d8-1ec047dd7626 tempest-GroupSnapshotsV319Test-126648943 None] Lock "cinder-quobyte-87bf095b-d3eb-47f1-83be-89b0a5b360a2" acquired by "_delete_snapshot" :: waited 0.101s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:04:30 devstack sudo[93948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d890488e-c1b6-4060-aed4-caaed3eaca63 1073741824 Sep 05 05:04:30 devstack sudo[93948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-ebbe98dd-fef1-4324-92d8-1ec047dd7626 tempest-GroupSnapshotsV319Test-126648943 None] Deleting offline snapshot 87bf095b-d3eb-47f1-83be-89b0a5b360a2 of volume 31a0fb50-191c-4327-97d3-49bb7bb6de77 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-ebbe98dd-fef1-4324-92d8-1ec047dd7626 tempest-GroupSnapshotsV319Test-126648943 None] snapshot_file for this snap is: volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.87bf095b-d3eb-47f1-83be-89b0a5b360a2 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8499db1a-b89b-4418-9382-40a99c5e2245]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ebbe98dd-fef1-4324-92d8-1ec047dd7626 tempest-GroupSnapshotsV319Test-126648943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.87bf095b-d3eb-47f1-83be-89b0a5b360a2 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:30 devstack sudo[93950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.87bf095b-d3eb-47f1-83be-89b0a5b360a2 Sep 05 05:04:30 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:30 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:30 devstack sudo[93948]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d890488e-c1b6-4060-aed4-caaed3eaca63 1073741824" returned: 0 in 0.630s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ebbe98dd-fef1-4324-92d8-1ec047dd7626 tempest-GroupSnapshotsV319Test-126648943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.87bf095b-d3eb-47f1-83be-89b0a5b360a2" returned: 0 in 0.553s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-ebbe98dd-fef1-4324-92d8-1ec047dd7626 tempest-GroupSnapshotsV319Test-126648943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31a0fb50-191c-4327-97d3-49bb7bb6de77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e40b9e-b375-4b1a-aba9-158254968a5e]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:04:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ebbe98dd-fef1-4324-92d8-1ec047dd7626 tempest-GroupSnapshotsV319Test-126648943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d890488e-c1b6-4060-aed4-caaed3eaca63 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:31 devstack sudo[93962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d890488e-c1b6-4060-aed4-caaed3eaca63 Sep 05 05:04:31 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:31 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77 Sep 05 05:04:31 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:31 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d890488e-c1b6-4060-aed4-caaed3eaca63" returned: 0 in 0.337s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (affe4e23-eb5a-49e0-8dad-fe357aa0b1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d890488e-c1b6-4060-aed4-caaed3eaca63', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58bc26ae-310c-425c-8bb4-6ad926a424a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:31 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Volume volume-d890488e-c1b6-4060-aed4-caaed3eaca63 (d890488e-c1b6-4060-aed4-caaed3eaca63): created successfully Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58bc26ae-310c-425c-8bb4-6ad926a424a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:31 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Flow 'volume_create_manager' (36cfaf77-1861-4a43-9b57-76501b5827c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ebbe98dd-fef1-4324-92d8-1ec047dd7626 tempest-GroupSnapshotsV319Test-126648943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77" returned: 0 in 0.490s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ebbe98dd-fef1-4324-92d8-1ec047dd7626 tempest-GroupSnapshotsV319Test-126648943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.87bf095b-d3eb-47f1-83be-89b0a5b360a2 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:31 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-2ea698b0-1d37-422f-9b5a-0fda79945ff1 tempest-AttachVolumeNegativeTest-203049611 None] Created volume successfully. Sep 05 05:04:31 devstack sudo[93969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.87bf095b-d3eb-47f1-83be-89b0a5b360a2 Sep 05 05:04:31 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Flow 'volume_create_manager' (4fab928d-d40c-4758-ad6e-bda13737e64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83b0afa-40b6-4e6d-83ba-05e7cab9bbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83b0afa-40b6-4e6d-83ba-05e7cab9bbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1813113952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bbce93-7d90-4bd3-813a-78278e327329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5e1c7cc5684fb0aa20ef92be4afdb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:04:32Z,use_quota=True,user_id='d71c0e8e09ee4d00a6a9e78503f79464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e820bedb-32cc-40c3-83fc-9ef27305b960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e820bedb-32cc-40c3-83fc-9ef27305b960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7eee45-6eb9-4abf-9831-2c9f00f2efdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7eee45-6eb9-4abf-9831-2c9f00f2efdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2bbce93-7d90-4bd3-813a-78278e327329', 'volume_name': 'volume-d2bbce93-7d90-4bd3-813a-78278e327329', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ed7cfb-1713-481b-8dae-3ba635c2e34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ed7cfb-1713-481b-8dae-3ba635c2e34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177b1de8-974c-4cef-9b5a-9ed9a82ca722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:31 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Volume d2bbce93-7d90-4bd3-813a-78278e327329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2bbce93-7d90-4bd3-813a-78278e327329', 'volume_size': 1} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1813113952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bbce93-7d90-4bd3-813a-78278e327329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5e1c7cc5684fb0aa20ef92be4afdb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:04:32Z,use_quota=True,user_id='d71c0e8e09ee4d00a6a9e78503f79464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Creating volume d2bbce93-7d90-4bd3-813a-78278e327329 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:04:31 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d2bbce93-7d90-4bd3-813a-78278e327329 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:31 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ebbe98dd-fef1-4324-92d8-1ec047dd7626 tempest-GroupSnapshotsV319Test-126648943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.87bf095b-d3eb-47f1-83be-89b0a5b360a2" returned: 0 in 0.521s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ebbe98dd-fef1-4324-92d8-1ec047dd7626 tempest-GroupSnapshotsV319Test-126648943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.87bf095b-d3eb-47f1-83be-89b0a5b360a2 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:31 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d2bbce93-7d90-4bd3-813a-78278e327329 1073741824 Sep 05 05:04:31 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:32 devstack sudo[93977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.87bf095b-d3eb-47f1-83be-89b0a5b360a2 Sep 05 05:04:32 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:32 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ebbe98dd-fef1-4324-92d8-1ec047dd7626 tempest-GroupSnapshotsV319Test-126648943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77.87bf095b-d3eb-47f1-83be-89b0a5b360a2" returned: 0 in 0.426s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:32 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ebbe98dd-fef1-4324-92d8-1ec047dd7626 tempest-GroupSnapshotsV319Test-126648943 None] Lock "cinder-quobyte-87bf095b-d3eb-47f1-83be-89b0a5b360a2" released by "_delete_snapshot" :: held 2.162s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:04:32 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ebbe98dd-fef1-4324-92d8-1ec047dd7626 tempest-GroupSnapshotsV319Test-126648943 None] Lock "cinder-quobyte-31a0fb50-191c-4327-97d3-49bb7bb6de77" released by "delete_snapshot" :: held 2.278s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:04:32 devstack cinder-volume[89331]: WARNING cinder.quota [None req-ebbe98dd-fef1-4324-92d8-1ec047dd7626 tempest-GroupSnapshotsV319Test-126648943 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-178264069 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-178264069, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:04:32 devstack cinder-volume[89331]: WARNING cinder.quota [None req-ebbe98dd-fef1-4324-92d8-1ec047dd7626 tempest-GroupSnapshotsV319Test-126648943 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-178264069 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-178264069, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:04:32 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-ebbe98dd-fef1-4324-92d8-1ec047dd7626 tempest-GroupSnapshotsV319Test-126648943 None] Created reservations ['1f79de0e-f968-44c9-bd39-c416fec34b2e', 'c7336844-a8cb-4a89-a4fc-90bfc589b03b', 'c418e48f-ecd2-4d7f-be14-6b4f9f7e6016', 'd6bada66-ce2f-4fcb-849e-5c9977524eda'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:04:32 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d2bbce93-7d90-4bd3-813a-78278e327329 1073741824" returned: 0 in 0.774s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d2bbce93-7d90-4bd3-813a-78278e327329 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:32 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ebbe98dd-fef1-4324-92d8-1ec047dd7626 tempest-GroupSnapshotsV319Test-126648943 None] group_snapshot 5e538b6f-4495-4ecc-b5b5-a5ed1c24d066: deleted successfully Sep 05 05:04:32 devstack sudo[93989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d2bbce93-7d90-4bd3-813a-78278e327329 Sep 05 05:04:32 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:33 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d2bbce93-7d90-4bd3-813a-78278e327329" returned: 0 in 0.379s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:04:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:04:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177b1de8-974c-4cef-9b5a-9ed9a82ca722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2bbce93-7d90-4bd3-813a-78278e327329', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93eec59e-44d9-493b-bcbe-a4aaea00cf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:33 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Volume volume-d2bbce93-7d90-4bd3-813a-78278e327329 (d2bbce93-7d90-4bd3-813a-78278e327329): created successfully Sep 05 05:04:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93eec59e-44d9-493b-bcbe-a4aaea00cf52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Flow 'volume_create_manager' (4fab928d-d40c-4758-ad6e-bda13737e64a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:04:33 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-eb7cd536-7168-492a-a445-0e19e6a95167 tempest-ServerActionsTestOtherA-74061543 None] Created volume successfully. Sep 05 05:04:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-0d534418-d22d-4fab-8c1f-fa0c7be394db req-d0eca12a-e96b-41b0-af3f-ebb625e2adfe tempest-AttachVolumeNegativeTest-203049611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:04:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-0d534418-d22d-4fab-8c1f-fa0c7be394db req-d0eca12a-e96b-41b0-af3f-ebb625e2adfe tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:04:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-0d534418-d22d-4fab-8c1f-fa0c7be394db req-d0eca12a-e96b-41b0-af3f-ebb625e2adfe tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:04:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-0d534418-d22d-4fab-8c1f-fa0c7be394db req-d0eca12a-e96b-41b0-af3f-ebb625e2adfe tempest-AttachVolumeNegativeTest-203049611 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136', 'name': 'volume-d890488e-c1b6-4060-aed4-caaed3eaca63', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee76b16f-edd6-428b-b2f4-747c65b5b564', 'enforce_multipath': True} {{(pid=89331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 05:04:33 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-0d534418-d22d-4fab-8c1f-fa0c7be394db req-d0eca12a-e96b-41b0-af3f-ebb625e2adfe tempest-AttachVolumeNegativeTest-203049611 None] attachment_update completed successfully. Sep 05 05:04:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c6b1aae7-1090-4da8-9141-576db6c56ae9 tempest-GroupSnapshotsV319Test-126648943 None] Acquiring lock "cinder-quobyte-31a0fb50-191c-4327-97d3-49bb7bb6de77" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:04:34 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c6b1aae7-1090-4da8-9141-576db6c56ae9 tempest-GroupSnapshotsV319Test-126648943 None] Lock "cinder-quobyte-31a0fb50-191c-4327-97d3-49bb7bb6de77" acquired by "delete_volume" :: waited 0.030s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:04:34 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5eb3e6-3503-44bb-80dc-689ff810ca83]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:04:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c6b1aae7-1090-4da8-9141-576db6c56ae9 tempest-GroupSnapshotsV319Test-126648943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:34 devstack sudo[94006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77 Sep 05 05:04:34 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:34 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c6b1aae7-1090-4da8-9141-576db6c56ae9 tempest-GroupSnapshotsV319Test-126648943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77" returned: 0 in 0.634s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c6b1aae7-1090-4da8-9141-576db6c56ae9 tempest-GroupSnapshotsV319Test-126648943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:34 devstack sudo[94011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77 Sep 05 05:04:34 devstack sudo[94011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:35 devstack sudo[94011]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c6b1aae7-1090-4da8-9141-576db6c56ae9 tempest-GroupSnapshotsV319Test-126648943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-31a0fb50-191c-4327-97d3-49bb7bb6de77" returned: 0 in 0.337s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:35 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c6b1aae7-1090-4da8-9141-576db6c56ae9 tempest-GroupSnapshotsV319Test-126648943 None] Lock "cinder-quobyte-31a0fb50-191c-4327-97d3-49bb7bb6de77" released by "delete_volume" :: held 1.054s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:04:35 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-c6b1aae7-1090-4da8-9141-576db6c56ae9 tempest-GroupSnapshotsV319Test-126648943 None] Created reservations ['c1ee3327-299e-4ccd-95f1-cf1a3f53baa0'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:04:35 devstack cinder-volume[89331]: WARNING cinder.quota [None req-c6b1aae7-1090-4da8-9141-576db6c56ae9 tempest-GroupSnapshotsV319Test-126648943 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-178264069 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-178264069, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:04:35 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-c6b1aae7-1090-4da8-9141-576db6c56ae9 tempest-GroupSnapshotsV319Test-126648943 None] Created reservations ['2ec5aa90-ddcd-45f4-a97a-dc4e046f567d', '4e94cf77-b723-4d80-a2e0-bf9e9acae266', '1fe90ef9-5761-4af3-a253-b2d93f370bb2', 'cb1c07ab-5224-4ac0-8e20-d9618c8f944c'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:04:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c6b1aae7-1090-4da8-9141-576db6c56ae9 tempest-GroupSnapshotsV319Test-126648943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:04:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c6b1aae7-1090-4da8-9141-576db6c56ae9 tempest-GroupSnapshotsV319Test-126648943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:04:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c6b1aae7-1090-4da8-9141-576db6c56ae9 tempest-GroupSnapshotsV319Test-126648943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:04:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c6b1aae7-1090-4da8-9141-576db6c56ae9 tempest-GroupSnapshotsV319Test-126648943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:04:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c6b1aae7-1090-4da8-9141-576db6c56ae9 tempest-GroupSnapshotsV319Test-126648943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:04:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c6b1aae7-1090-4da8-9141-576db6c56ae9 tempest-GroupSnapshotsV319Test-126648943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:35 devstack sudo[94014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:04:35 devstack sudo[94014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:35 devstack sudo[94014]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c6b1aae7-1090-4da8-9141-576db6c56ae9 tempest-GroupSnapshotsV319Test-126648943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.300s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:35 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-c6b1aae7-1090-4da8-9141-576db6c56ae9 tempest-GroupSnapshotsV319Test-126648943 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:04:35 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-c6b1aae7-1090-4da8-9141-576db6c56ae9 tempest-GroupSnapshotsV319Test-126648943 None] Delete group completed successfully. Sep 05 05:04:45 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=69,cinder:UPDATE=56,cinder:INSERT=10,cinder:DELETE=5 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:04:45 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:UPDATE=81,cinder:SELECT=61,cinder:DELETE=5,cinder:INSERT=19 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:04:47 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-49aa8093-f994-416f-a975-3c9dfab66f2e tempest-GroupsV314Test-1253878730 None] Group tempest-GroupsV314Test-Group-2108714143: creating Sep 05 05:04:47 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-49aa8093-f994-416f-a975-3c9dfab66f2e tempest-GroupsV314Test-1253878730 None] Group tempest-GroupsV314Test-Group-2108714143: created successfully Sep 05 05:04:47 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-49aa8093-f994-416f-a975-3c9dfab66f2e tempest-GroupsV314Test-1253878730 None] Create group completed successfully. Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:49 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:04:49 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Flow 'volume_create_manager' (0469a444-c736-441a-96f9-738ee791f46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17fd8e6-0b25-4d20-9942-1a4ce821e77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17fd8e6-0b25-4d20-9942-1a4ce821e77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1896157395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d28d60bb-ee1a-4af6-93af-2bb8e811105b,host='devstack@QuobyteHD#QuobyteHD',id=1bb1353c-288b-4928-af81-21097e8346a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c395d208bb324ba9abe114f24d648835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:04:50Z,use_quota=True,user_id='89ae7c26a5b44e5e8268ca92d67f84e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89fdde04-797b-4c3b-bd6a-593a8dcfe77f),volume_type_id=89fdde04-797b-4c3b-bd6a-593a8dcfe77f)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8cd43b8-0add-4625-895d-94ab3f85353e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8cd43b8-0add-4625-895d-94ab3f85353e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e636d6-9e94-4ecc-a82c-92ea34809b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e636d6-9e94-4ecc-a82c-92ea34809b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bb1353c-288b-4928-af81-21097e8346a0', 'volume_name': 'volume-1bb1353c-288b-4928-af81-21097e8346a0', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f394b278-23cd-4e4c-bd2b-40886962aa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f394b278-23cd-4e4c-bd2b-40886962aa02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fa0589-ceb1-4bb9-b3e0-44fda95df2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:49 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Volume 1bb1353c-288b-4928-af81-21097e8346a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bb1353c-288b-4928-af81-21097e8346a0', 'volume_size': 1} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d28d60bb-ee1a-4af6-93af-2bb8e811105b,created_at=2026-09-05T03:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1896157395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d28d60bb-ee1a-4af6-93af-2bb8e811105b,host='devstack@QuobyteHD#QuobyteHD',id=1bb1353c-288b-4928-af81-21097e8346a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c395d208bb324ba9abe114f24d648835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:04:50Z,use_quota=True,user_id='89ae7c26a5b44e5e8268ca92d67f84e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89fdde04-797b-4c3b-bd6a-593a8dcfe77f),volume_type_id=89fdde04-797b-4c3b-bd6a-593a8dcfe77f)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Creating volume 1bb1353c-288b-4928-af81-21097e8346a0 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:04:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:04:49 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:04:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:50 devstack sudo[94229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0 1073741824 Sep 05 05:04:50 devstack sudo[94229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:50 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.817s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:50 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:04:50 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager._thread_info {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:04:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread count: 8 {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 05:04:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread info: [<_MainThread(MainThread, started 139182109970560)>, , , , , , , ] {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 05:04:51 devstack sudo[94229]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0 1073741824" returned: 0 in 1.402s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:51 devstack sudo[94241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0 Sep 05 05:04:51 devstack sudo[94241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:51 devstack sudo[94241]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0" returned: 0 in 0.469s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:04:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:04:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fa0589-ceb1-4bb9-b3e0-44fda95df2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bb1353c-288b-4928-af81-21097e8346a0', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1090c0-86a8-4f74-8390-8d6fd118cbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:04:52 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Volume volume-1bb1353c-288b-4928-af81-21097e8346a0 (1bb1353c-288b-4928-af81-21097e8346a0): created successfully Sep 05 05:04:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1090c0-86a8-4f74-8390-8d6fd118cbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:04:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Flow 'volume_create_manager' (0469a444-c736-441a-96f9-738ee791f46e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:04:52 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-2cdc4754-3949-42ca-9f94-95590b2d52d8 tempest-GroupsV314Test-1253878730 None] Created volume successfully. Sep 05 05:04:53 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-5ea79a81-e831-4341-a0ad-d567fbcd064f req-ecc20dda-4cdf-4e48-97b0-68c5b3c20aee tempest-AttachVolumeTestJSON-200281865 None] Terminate volume connection completed successfully. Sep 05 05:04:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-5ea79a81-e831-4341-a0ad-d567fbcd064f req-ecc20dda-4cdf-4e48-97b0-68c5b3c20aee tempest-AttachVolumeTestJSON-200281865 None] Deleting attachment 54b0e075-d01c-40ff-a1d4-c82c8fd84b38. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:04:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:04:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:04:53 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Cloning volume 1bb1353c-288b-4928-af81-21097e8346a0 to volume ffeaff03-e189-48b0-9956-60b379841054 Sep 05 05:04:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Creating offline snapshot 66e237e4-70dd-4aed-a632-57cb9a573076 of volume 1bb1353c-288b-4928-af81-21097e8346a0 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:04:54 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4792dee6-0ca6-4a31-8c9d-f3ad28fc06dd]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:04:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:54 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0 Sep 05 05:04:54 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:54 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0" returned: 0 in 0.732s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.66e237e4-70dd-4aed-a632-57cb9a573076 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:54 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.66e237e4-70dd-4aed-a632-57cb9a573076 1G Sep 05 05:04:54 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:55 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.66e237e4-70dd-4aed-a632-57cb9a573076 1G" returned: 0 in 0.397s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bb1353c-288b-4928-af81-21097e8346a0 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.66e237e4-70dd-4aed-a632-57cb9a573076 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:55 devstack sudo[94273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bb1353c-288b-4928-af81-21097e8346a0 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.66e237e4-70dd-4aed-a632-57cb9a573076 Sep 05 05:04:55 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:55 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bb1353c-288b-4928-af81-21097e8346a0 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.66e237e4-70dd-4aed-a632-57cb9a573076" returned: 0 in 0.280s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:55 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.66e237e4-70dd-4aed-a632-57cb9a573076 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 05:04:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.66e237e4-70dd-4aed-a632-57cb9a573076 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:55 devstack sudo[94279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.66e237e4-70dd-4aed-a632-57cb9a573076 Sep 05 05:04:55 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:55 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.66e237e4-70dd-4aed-a632-57cb9a573076" returned: 0 in 0.322s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:55 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.info Sep 05 05:04:55 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:56 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.info" returned: 0 in 0.326s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:56 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 05:04:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:56 devstack sudo[94286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.info Sep 05 05:04:56 devstack sudo[94286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:56 devstack sudo[94286]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.info" returned: 0 in 0.478s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Acquiring lock "cinder-quobyte-ffeaff03-e189-48b0-9956-60b379841054" by "_copy_volume_from_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:04:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Lock "cinder-quobyte-ffeaff03-e189-48b0-9956-60b379841054" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:04:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] snapshot: 66e237e4-70dd-4aed-a632-57cb9a573076, volume: ffeaff03-e189-48b0-9956-60b379841054, {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 05:04:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:04:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:04:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:04:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:04:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:04:56 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3e5992-f728-4bb0-a461-6dea7fdb4f09]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:04:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.66e237e4-70dd-4aed-a632-57cb9a573076 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:56 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.66e237e4-70dd-4aed-a632-57cb9a573076 Sep 05 05:04:56 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:57 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.66e237e4-70dd-4aed-a632-57cb9a573076" returned: 0 in 0.493s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bb1353c-288b-4928-af81-21097e8346a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:04:57 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c63ef2-924d-4dd4-b71b-2bbb2cad1e8f]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:04:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:57 devstack sudo[94294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0 Sep 05 05:04:57 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:04:57 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root Sep 05 05:04:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0" returned: 0 in 0.615s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:04:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0 {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 05:04:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Creating direct copy from snapshot {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 05:04:57 devstack cinder-volume[89331]: DEBUG cinder.utils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Path /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ffeaff03-e189-48b0-9956-60b379841054 not found in is_blk_device check {{(pid=89331) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 05:04:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ffeaff03-e189-48b0-9956-60b379841054 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:04:57 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ffeaff03-e189-48b0-9956-60b379841054 Sep 05 05:04:57 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:05 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:05:05 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:05:06 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ffeaff03-e189-48b0-9956-60b379841054" returned: 0 in 8.861s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:06 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0, size 1024.00 MB, duration 8.86 sec, destination /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ffeaff03-e189-48b0-9956-60b379841054 {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:05:06 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Converted 1024.00 MB image at 115.54 MB/s Sep 05 05:05:06 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ffeaff03-e189-48b0-9956-60b379841054 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 05:05:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ffeaff03-e189-48b0-9956-60b379841054 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:06 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ffeaff03-e189-48b0-9956-60b379841054 Sep 05 05:05:06 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:07 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ffeaff03-e189-48b0-9956-60b379841054" returned: 0 in 0.282s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Lock "cinder-quobyte-ffeaff03-e189-48b0-9956-60b379841054" released by "_copy_volume_from_snapshot" :: held 10.353s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:05:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Acquiring lock "cinder-quobyte-66e237e4-70dd-4aed-a632-57cb9a573076" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:05:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Lock "cinder-quobyte-66e237e4-70dd-4aed-a632-57cb9a573076" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:05:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Deleting offline snapshot 66e237e4-70dd-4aed-a632-57cb9a573076 of volume 1bb1353c-288b-4928-af81-21097e8346a0 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:05:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] snapshot_file for this snap is: volume-1bb1353c-288b-4928-af81-21097e8346a0.66e237e4-70dd-4aed-a632-57cb9a573076 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:05:07 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9d6ea0-8edd-4cb7-a53e-0e570699d41c]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:05:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.66e237e4-70dd-4aed-a632-57cb9a573076 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:07 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.66e237e4-70dd-4aed-a632-57cb9a573076 Sep 05 05:05:07 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:07 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.66e237e4-70dd-4aed-a632-57cb9a573076" returned: 0 in 0.417s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bb1353c-288b-4928-af81-21097e8346a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:05:07 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eba5b2f-2eed-43e6-820c-6d703b720a9a]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:05:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:07 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0 Sep 05 05:05:07 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:08 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0" returned: 0 in 0.561s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.66e237e4-70dd-4aed-a632-57cb9a573076 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:08 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.66e237e4-70dd-4aed-a632-57cb9a573076 Sep 05 05:05:08 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:08 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.66e237e4-70dd-4aed-a632-57cb9a573076" returned: 0 in 0.353s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.66e237e4-70dd-4aed-a632-57cb9a573076 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:08 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.66e237e4-70dd-4aed-a632-57cb9a573076 Sep 05 05:05:08 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:08 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0.66e237e4-70dd-4aed-a632-57cb9a573076" returned: 0 in 0.250s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Lock "cinder-quobyte-66e237e4-70dd-4aed-a632-57cb9a573076" released by "_delete_snapshot" :: held 1.680s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:05:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.950s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:05:08 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-a5e2f9c2-4aca-41f5-b988-2a0afd570dbf tempest-GroupsV314Test-1253878730 None] Create group from source-group-d28d60bb-ee1a-4af6-93af-2bb8e811105b completed successfully. Sep 05 05:05:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1eacd6bc-9cd5-4b11-9366-1dfaecc69822 tempest-GroupsV314Test-1253878730 None] Acquiring lock "cinder-quobyte-ffeaff03-e189-48b0-9956-60b379841054" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:05:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1eacd6bc-9cd5-4b11-9366-1dfaecc69822 tempest-GroupsV314Test-1253878730 None] Lock "cinder-quobyte-ffeaff03-e189-48b0-9956-60b379841054" acquired by "delete_volume" :: waited 0.016s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:05:09 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1376dc-a5f9-48b8-ba9b-3a6fed731f29]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:05:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1eacd6bc-9cd5-4b11-9366-1dfaecc69822 tempest-GroupsV314Test-1253878730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ffeaff03-e189-48b0-9956-60b379841054 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:09 devstack sudo[94498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ffeaff03-e189-48b0-9956-60b379841054 Sep 05 05:05:09 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:09 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1eacd6bc-9cd5-4b11-9366-1dfaecc69822 tempest-GroupsV314Test-1253878730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ffeaff03-e189-48b0-9956-60b379841054" returned: 0 in 0.370s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1eacd6bc-9cd5-4b11-9366-1dfaecc69822 tempest-GroupsV314Test-1253878730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ffeaff03-e189-48b0-9956-60b379841054 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:09 devstack sudo[94503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ffeaff03-e189-48b0-9956-60b379841054 Sep 05 05:05:09 devstack sudo[94503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:10 devstack sudo[94503]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1eacd6bc-9cd5-4b11-9366-1dfaecc69822 tempest-GroupsV314Test-1253878730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ffeaff03-e189-48b0-9956-60b379841054" returned: 0 in 0.269s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1eacd6bc-9cd5-4b11-9366-1dfaecc69822 tempest-GroupsV314Test-1253878730 None] Lock "cinder-quobyte-ffeaff03-e189-48b0-9956-60b379841054" released by "delete_volume" :: held 0.686s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:05:10 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-1eacd6bc-9cd5-4b11-9366-1dfaecc69822 tempest-GroupsV314Test-1253878730 None] Created reservations ['36a1cf10-89af-447a-a8f9-fc5182247913'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:05:10 devstack cinder-volume[89331]: WARNING cinder.quota [None req-1eacd6bc-9cd5-4b11-9366-1dfaecc69822 tempest-GroupsV314Test-1253878730 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1696175969 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1696175969, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:05:10 devstack cinder-volume[89331]: WARNING cinder.quota [None req-1eacd6bc-9cd5-4b11-9366-1dfaecc69822 tempest-GroupsV314Test-1253878730 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1696175969 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1696175969, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:05:10 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-1eacd6bc-9cd5-4b11-9366-1dfaecc69822 tempest-GroupsV314Test-1253878730 None] Created reservations ['585f03e9-0a46-474a-a8bf-e5937b9c7096', '6105e07f-9802-4147-aefc-df9eaaa255aa', 'c371cb30-efb9-42b0-84bc-fca7ae938776', '59041425-8224-4589-8115-627d7762c9a4'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:05:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1eacd6bc-9cd5-4b11-9366-1dfaecc69822 tempest-GroupsV314Test-1253878730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:05:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1eacd6bc-9cd5-4b11-9366-1dfaecc69822 tempest-GroupsV314Test-1253878730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:05:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-1eacd6bc-9cd5-4b11-9366-1dfaecc69822 tempest-GroupsV314Test-1253878730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:05:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-1eacd6bc-9cd5-4b11-9366-1dfaecc69822 tempest-GroupsV314Test-1253878730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:05:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1eacd6bc-9cd5-4b11-9366-1dfaecc69822 tempest-GroupsV314Test-1253878730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:05:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1eacd6bc-9cd5-4b11-9366-1dfaecc69822 tempest-GroupsV314Test-1253878730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:10 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:05:10 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:10 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1eacd6bc-9cd5-4b11-9366-1dfaecc69822 tempest-GroupsV314Test-1253878730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.319s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:10 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-1eacd6bc-9cd5-4b11-9366-1dfaecc69822 tempest-GroupsV314Test-1253878730 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:05:10 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-1eacd6bc-9cd5-4b11-9366-1dfaecc69822 tempest-GroupsV314Test-1253878730 None] Delete group completed successfully. Sep 05 05:05:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-79dd79ae-eef9-4742-9b39-2ec2aef261a0 tempest-GroupsV314Test-1253878730 None] Acquiring lock "cinder-quobyte-1bb1353c-288b-4928-af81-21097e8346a0" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:05:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-79dd79ae-eef9-4742-9b39-2ec2aef261a0 tempest-GroupsV314Test-1253878730 None] Lock "cinder-quobyte-1bb1353c-288b-4928-af81-21097e8346a0" acquired by "delete_volume" :: waited 0.021s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:05:11 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3ff1a2-5eaa-4ce3-a8c0-0ee84149c2e7]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:05:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-79dd79ae-eef9-4742-9b39-2ec2aef261a0 tempest-GroupsV314Test-1253878730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:11 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0 Sep 05 05:05:11 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:11 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-79dd79ae-eef9-4742-9b39-2ec2aef261a0 tempest-GroupsV314Test-1253878730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0" returned: 0 in 0.539s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-79dd79ae-eef9-4742-9b39-2ec2aef261a0 tempest-GroupsV314Test-1253878730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:11 devstack sudo[94529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0 Sep 05 05:05:11 devstack sudo[94529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-8796c7de-8a49-4184-8165-1bb4f252c0c7 req-b58c9b57-2c2e-447a-8093-a348e99f8a16 tempest-ServerActionsTestOtherA-74061543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:05:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-8796c7de-8a49-4184-8165-1bb4f252c0c7 req-b58c9b57-2c2e-447a-8093-a348e99f8a16 tempest-ServerActionsTestOtherA-74061543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:05:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-8796c7de-8a49-4184-8165-1bb4f252c0c7 req-b58c9b57-2c2e-447a-8093-a348e99f8a16 tempest-ServerActionsTestOtherA-74061543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:05:11 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-8796c7de-8a49-4184-8165-1bb4f252c0c7 req-b58c9b57-2c2e-447a-8093-a348e99f8a16 tempest-ServerActionsTestOtherA-74061543 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136', 'name': 'volume-d2bbce93-7d90-4bd3-813a-78278e327329', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b943ac40-2bdb-43ec-b424-175405ed348f', 'enforce_multipath': True} {{(pid=89331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 05:05:11 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-8796c7de-8a49-4184-8165-1bb4f252c0c7 req-b58c9b57-2c2e-447a-8093-a348e99f8a16 tempest-ServerActionsTestOtherA-74061543 None] attachment_update completed successfully. Sep 05 05:05:12 devstack sudo[94529]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-79dd79ae-eef9-4742-9b39-2ec2aef261a0 tempest-GroupsV314Test-1253878730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1bb1353c-288b-4928-af81-21097e8346a0" returned: 0 in 0.388s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-79dd79ae-eef9-4742-9b39-2ec2aef261a0 tempest-GroupsV314Test-1253878730 None] Lock "cinder-quobyte-1bb1353c-288b-4928-af81-21097e8346a0" released by "delete_volume" :: held 1.011s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:05:12 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-79dd79ae-eef9-4742-9b39-2ec2aef261a0 tempest-GroupsV314Test-1253878730 None] Created reservations ['f9f15339-d1b4-49db-acfc-6674ef857407'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:05:12 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-79dd79ae-eef9-4742-9b39-2ec2aef261a0 tempest-GroupsV314Test-1253878730 None] Created reservations ['4a672fc3-d983-4bd5-b63b-c86ba09379ae', '146477a6-83ea-482d-98f4-fb3f5db11492', '5f41f4c2-230f-455c-a9d6-8d0de8805383', '0f23aa1f-554c-45e9-a1d2-26cb6b14c336'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:05:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-79dd79ae-eef9-4742-9b39-2ec2aef261a0 tempest-GroupsV314Test-1253878730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:05:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-79dd79ae-eef9-4742-9b39-2ec2aef261a0 tempest-GroupsV314Test-1253878730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:05:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-79dd79ae-eef9-4742-9b39-2ec2aef261a0 tempest-GroupsV314Test-1253878730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:05:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-79dd79ae-eef9-4742-9b39-2ec2aef261a0 tempest-GroupsV314Test-1253878730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:05:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-79dd79ae-eef9-4742-9b39-2ec2aef261a0 tempest-GroupsV314Test-1253878730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:05:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-79dd79ae-eef9-4742-9b39-2ec2aef261a0 tempest-GroupsV314Test-1253878730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:12 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:05:12 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:12 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-79dd79ae-eef9-4742-9b39-2ec2aef261a0 tempest-GroupsV314Test-1253878730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.308s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:12 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-79dd79ae-eef9-4742-9b39-2ec2aef261a0 tempest-GroupsV314Test-1253878730 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:05:12 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-79dd79ae-eef9-4742-9b39-2ec2aef261a0 tempest-GroupsV314Test-1253878730 None] Delete group completed successfully. Sep 05 05:05:15 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-45ed77a4-b08d-4e42-8b76-f4fe840149e6 req-9b6f139f-298f-49a3-b720-64dcb5713778 tempest-ServerActionsTestOtherA-74061543 None] Terminate volume connection completed successfully. Sep 05 05:05:15 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-45ed77a4-b08d-4e42-8b76-f4fe840149e6 req-9b6f139f-298f-49a3-b720-64dcb5713778 tempest-ServerActionsTestOtherA-74061543 None] Deleting attachment b943ac40-2bdb-43ec-b424-175405ed348f. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:05:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-45ed77a4-b08d-4e42-8b76-f4fe840149e6 req-39235309-f182-4498-8ddb-e223410fd7af tempest-ServerActionsTestOtherA-74061543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:05:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-45ed77a4-b08d-4e42-8b76-f4fe840149e6 req-39235309-f182-4498-8ddb-e223410fd7af tempest-ServerActionsTestOtherA-74061543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:05:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-45ed77a4-b08d-4e42-8b76-f4fe840149e6 req-39235309-f182-4498-8ddb-e223410fd7af tempest-ServerActionsTestOtherA-74061543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:05:17 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-45ed77a4-b08d-4e42-8b76-f4fe840149e6 req-39235309-f182-4498-8ddb-e223410fd7af tempest-ServerActionsTestOtherA-74061543 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136', 'name': 'volume-d2bbce93-7d90-4bd3-813a-78278e327329', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fbd4d8f9-ab05-47c7-90c6-80d5d6f40c44', 'enforce_multipath': True} {{(pid=89331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 05:05:17 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-45ed77a4-b08d-4e42-8b76-f4fe840149e6 req-39235309-f182-4498-8ddb-e223410fd7af tempest-ServerActionsTestOtherA-74061543 None] attachment_update completed successfully. Sep 05 05:05:23 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-ee9e55c8-1e20-4100-88e6-128d2f104015 req-9e88fd9c-43a5-4a3a-9694-49344069bf87 tempest-AttachVolumeNegativeTest-203049611 None] Terminate volume connection completed successfully. Sep 05 05:05:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-ee9e55c8-1e20-4100-88e6-128d2f104015 req-9e88fd9c-43a5-4a3a-9694-49344069bf87 tempest-AttachVolumeNegativeTest-203049611 None] Deleting attachment ee76b16f-edd6-428b-b2f4-747c65b5b564. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:05:33 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:UPDATE=29,cinder:SELECT=33,cinder:INSERT=4 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:05:33 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:UPDATE=26,cinder:SELECT=33,cinder:INSERT=6 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:05:34 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:05:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Flow 'volume_create_manager' (fd5fb5c5-0664-4ba0-9930-5c87edf6fe7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:05:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f423cd-068e-4116-8af0-fe4f66adb0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:05:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f423cd-068e-4116-8af0-fe4f66adb0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1857693692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770da1e4-2749-487a-aa43-ac38740b0247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad7ba6741e6444ab01c742034c87080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:05:35Z,use_quota=True,user_id='81693edc5d4147febeb55a3b8d49cbe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:05:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b466b3e0-58df-414d-bb3b-4746129e9395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:05:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b466b3e0-58df-414d-bb3b-4746129e9395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:05:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d39306d8-1c1c-4de3-82f4-23dd59316da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:05:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d39306d8-1c1c-4de3-82f4-23dd59316da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '770da1e4-2749-487a-aa43-ac38740b0247', 'volume_name': 'volume-770da1e4-2749-487a-aa43-ac38740b0247', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:05:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd8cafd-672e-4cc7-99ea-9c3fc90e2897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:05:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd8cafd-672e-4cc7-99ea-9c3fc90e2897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:05:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34ab30c3-3f56-4512-a455-0f9831018d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:05:34 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Volume 770da1e4-2749-487a-aa43-ac38740b0247: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-770da1e4-2749-487a-aa43-ac38740b0247', 'volume_size': 1} Sep 05 05:05:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:05:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:05:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1857693692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770da1e4-2749-487a-aa43-ac38740b0247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad7ba6741e6444ab01c742034c87080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:05:35Z,use_quota=True,user_id='81693edc5d4147febeb55a3b8d49cbe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:05:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Creating volume 770da1e4-2749-487a-aa43-ac38740b0247 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:05:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:05:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:05:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:05:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:05:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:05:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:05:34 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:05:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:34 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247 1073741824 Sep 05 05:05:34 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:35 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247 1073741824" returned: 0 in 0.586s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:35 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247 Sep 05 05:05:35 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:35 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247" returned: 0 in 0.311s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:05:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:05:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34ab30c3-3f56-4512-a455-0f9831018d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770da1e4-2749-487a-aa43-ac38740b0247', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:05:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1397b969-c547-460d-ab63-596e17668bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:05:35 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Volume volume-770da1e4-2749-487a-aa43-ac38740b0247 (770da1e4-2749-487a-aa43-ac38740b0247): created successfully Sep 05 05:05:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1397b969-c547-460d-ab63-596e17668bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:05:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Flow 'volume_create_manager' (fd5fb5c5-0664-4ba0-9930-5c87edf6fe7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:05:35 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-945f132e-2e40-42b8-abff-a3fe5e860cdf tempest-SnapshotsActionsTest-914703108 None] Created volume successfully. Sep 05 05:05:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5bbca341-d275-4964-be8d-139a7e83b764 tempest-SnapshotsActionsTest-914703108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:05:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5bbca341-d275-4964-be8d-139a7e83b764 tempest-SnapshotsActionsTest-914703108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:05:37 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-5bbca341-d275-4964-be8d-139a7e83b764 tempest-SnapshotsActionsTest-914703108 None] Creating offline snapshot 3b6a962d-79bd-4ee8-bdc0-a370e81964c5 of volume 770da1e4-2749-487a-aa43-ac38740b0247 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:05:37 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1347de-e507-448a-b0d8-5ec987d1c448]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:05:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5bbca341-d275-4964-be8d-139a7e83b764 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:37 devstack sudo[94810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247 Sep 05 05:05:37 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:37 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5bbca341-d275-4964-be8d-139a7e83b764 tempest-SnapshotsActionsTest-914703108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247" returned: 0 in 0.512s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5bbca341-d275-4964-be8d-139a7e83b764 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:37 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 1G Sep 05 05:05:37 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:38 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5bbca341-d275-4964-be8d-139a7e83b764 tempest-SnapshotsActionsTest-914703108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 1G" returned: 0 in 0.499s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5bbca341-d275-4964-be8d-139a7e83b764 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770da1e4-2749-487a-aa43-ac38740b0247 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:38 devstack sudo[94833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770da1e4-2749-487a-aa43-ac38740b0247 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 Sep 05 05:05:38 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:38 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5bbca341-d275-4964-be8d-139a7e83b764 tempest-SnapshotsActionsTest-914703108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770da1e4-2749-487a-aa43-ac38740b0247 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5" returned: 0 in 0.359s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:38 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-5bbca341-d275-4964-be8d-139a7e83b764 tempest-SnapshotsActionsTest-914703108 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 is being set with open permissions: ugo+rw Sep 05 05:05:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5bbca341-d275-4964-be8d-139a7e83b764 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:38 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 Sep 05 05:05:38 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:38 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5bbca341-d275-4964-be8d-139a7e83b764 tempest-SnapshotsActionsTest-914703108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5" returned: 0 in 0.294s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5bbca341-d275-4964-be8d-139a7e83b764 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:38 devstack sudo[94842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.info Sep 05 05:05:38 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:39 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5bbca341-d275-4964-be8d-139a7e83b764 tempest-SnapshotsActionsTest-914703108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.info" returned: 0 in 0.471s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:39 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-5bbca341-d275-4964-be8d-139a7e83b764 tempest-SnapshotsActionsTest-914703108 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.info is being set with open permissions: ugo+rw Sep 05 05:05:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5bbca341-d275-4964-be8d-139a7e83b764 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:39 devstack sudo[94882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.info Sep 05 05:05:39 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:39 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5bbca341-d275-4964-be8d-139a7e83b764 tempest-SnapshotsActionsTest-914703108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.info" returned: 0 in 0.378s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5bbca341-d275-4964-be8d-139a7e83b764 tempest-SnapshotsActionsTest-914703108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.666s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:05:39 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-5bbca341-d275-4964-be8d-139a7e83b764 tempest-SnapshotsActionsTest-914703108 None] Create snapshot completed successfully Sep 05 05:05:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-af24997f-f1ba-4379-945c-483beb152bee tempest-SnapshotsActionsTest-914703108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:05:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-af24997f-f1ba-4379-945c-483beb152bee tempest-SnapshotsActionsTest-914703108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:05:41 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-af24997f-f1ba-4379-945c-483beb152bee tempest-SnapshotsActionsTest-914703108 None] Creating offline snapshot 4193fd4f-3840-4e89-8c72-f4c4b0e6807a of volume 770da1e4-2749-487a-aa43-ac38740b0247 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:05:42 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20b070e-0f25-444d-ac2c-658ad2b431a3]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:05:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-af24997f-f1ba-4379-945c-483beb152bee tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:42 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 Sep 05 05:05:42 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:42 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-af24997f-f1ba-4379-945c-483beb152bee tempest-SnapshotsActionsTest-914703108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5" returned: 0 in 0.902s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:42 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-af24997f-f1ba-4379-945c-483beb152bee tempest-SnapshotsActionsTest-914703108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770da1e4-2749-487a-aa43-ac38740b0247(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:05:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-af24997f-f1ba-4379-945c-483beb152bee tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.4193fd4f-3840-4e89-8c72-f4c4b0e6807a 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:43 devstack sudo[94983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.4193fd4f-3840-4e89-8c72-f4c4b0e6807a 1G Sep 05 05:05:43 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:43 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-af24997f-f1ba-4379-945c-483beb152bee tempest-SnapshotsActionsTest-914703108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.4193fd4f-3840-4e89-8c72-f4c4b0e6807a 1G" returned: 0 in 0.869s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-af24997f-f1ba-4379-945c-483beb152bee tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.4193fd4f-3840-4e89-8c72-f4c4b0e6807a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:43 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.4193fd4f-3840-4e89-8c72-f4c4b0e6807a Sep 05 05:05:43 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:44 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-af24997f-f1ba-4379-945c-483beb152bee tempest-SnapshotsActionsTest-914703108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.4193fd4f-3840-4e89-8c72-f4c4b0e6807a" returned: 0 in 0.543s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:44 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-af24997f-f1ba-4379-945c-483beb152bee tempest-SnapshotsActionsTest-914703108 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.4193fd4f-3840-4e89-8c72-f4c4b0e6807a is being set with open permissions: ugo+rw Sep 05 05:05:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-af24997f-f1ba-4379-945c-483beb152bee tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.4193fd4f-3840-4e89-8c72-f4c4b0e6807a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:44 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.4193fd4f-3840-4e89-8c72-f4c4b0e6807a Sep 05 05:05:44 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:44 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-af24997f-f1ba-4379-945c-483beb152bee tempest-SnapshotsActionsTest-914703108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.4193fd4f-3840-4e89-8c72-f4c4b0e6807a" returned: 0 in 0.554s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-af24997f-f1ba-4379-945c-483beb152bee tempest-SnapshotsActionsTest-914703108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.117s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:05:45 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-af24997f-f1ba-4379-945c-483beb152bee tempest-SnapshotsActionsTest-914703108 None] Create snapshot completed successfully Sep 05 05:05:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] Acquiring lock "cinder-4193fd4f-3840-4e89-8c72-f4c4b0e6807a-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:05:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-4193fd4f-3840-4e89-8c72-f4c4b0e6807a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:05:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] Acquiring lock "cinder-quobyte-770da1e4-2749-487a-aa43-ac38740b0247" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:05:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-quobyte-770da1e4-2749-487a-aa43-ac38740b0247" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:05:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] Acquiring lock "cinder-quobyte-4193fd4f-3840-4e89-8c72-f4c4b0e6807a" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:05:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-quobyte-4193fd4f-3840-4e89-8c72-f4c4b0e6807a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:05:46 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] Deleting offline snapshot 4193fd4f-3840-4e89-8c72-f4c4b0e6807a of volume 770da1e4-2749-487a-aa43-ac38740b0247 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:05:46 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] snapshot_file for this snap is: volume-770da1e4-2749-487a-aa43-ac38740b0247.4193fd4f-3840-4e89-8c72-f4c4b0e6807a {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:05:46 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2950e48-c3d1-4d7a-be3c-c8a8509c8c31]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:05:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.4193fd4f-3840-4e89-8c72-f4c4b0e6807a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:46 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.4193fd4f-3840-4e89-8c72-f4c4b0e6807a Sep 05 05:05:46 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:47 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.4193fd4f-3840-4e89-8c72-f4c4b0e6807a" returned: 0 in 0.769s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770da1e4-2749-487a-aa43-ac38740b0247(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:05:47 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4623b64b-3e52-4e9d-b975-cf0a8262044f]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:05:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:47 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 Sep 05 05:05:47 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:47 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5" returned: 0 in 0.465s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770da1e4-2749-487a-aa43-ac38740b0247(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:05:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.4193fd4f-3840-4e89-8c72-f4c4b0e6807a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:47 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.4193fd4f-3840-4e89-8c72-f4c4b0e6807a Sep 05 05:05:47 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:48 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.4193fd4f-3840-4e89-8c72-f4c4b0e6807a" returned: 0 in 0.357s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.4193fd4f-3840-4e89-8c72-f4c4b0e6807a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:48 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.4193fd4f-3840-4e89-8c72-f4c4b0e6807a Sep 05 05:05:48 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:48 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.4193fd4f-3840-4e89-8c72-f4c4b0e6807a" returned: 0 in 0.248s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-quobyte-4193fd4f-3840-4e89-8c72-f4c4b0e6807a" released by "_delete_snapshot" :: held 1.970s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:05:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-quobyte-770da1e4-2749-487a-aa43-ac38740b0247" released by "delete_snapshot" :: held 2.006s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:05:48 devstack cinder-volume[89331]: WARNING cinder.quota [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:05:48 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] Created reservations ['35df7215-7cb6-4fcd-a7b5-29f40a3b96d5', 'cdd7f8fe-fd86-4630-a741-68d4aa7d464e', '46b80452-78ad-47ca-a84a-0f202b5b2b66', '526b5f90-9832-4229-8998-8e0c1c371746'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:05:48 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] Delete snapshot completed successfully. Sep 05 05:05:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-96bcca8b-b621-4929-bc3e-66a88dfe32fd tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-4193fd4f-3840-4e89-8c72-f4c4b0e6807a-delete_snapshot" released by "delete_snapshot" :: held 2.173s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:05:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6ef4ddc4-5857-442a-9b72-7cec5ab836f7 tempest-SnapshotsActionsTest-914703108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:05:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6ef4ddc4-5857-442a-9b72-7cec5ab836f7 tempest-SnapshotsActionsTest-914703108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:05:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-6ef4ddc4-5857-442a-9b72-7cec5ab836f7 tempest-SnapshotsActionsTest-914703108 None] Creating offline snapshot bd4b7da2-730e-49c7-8672-e20f10c1c681 of volume 770da1e4-2749-487a-aa43-ac38740b0247 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:05:49 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7aa6e2-968b-472a-9c4c-a172f79d60e0]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:05:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6ef4ddc4-5857-442a-9b72-7cec5ab836f7 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:49 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 Sep 05 05:05:49 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:49 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6ef4ddc4-5857-442a-9b72-7cec5ab836f7 tempest-SnapshotsActionsTest-914703108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5" returned: 0 in 0.408s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-6ef4ddc4-5857-442a-9b72-7cec5ab836f7 tempest-SnapshotsActionsTest-914703108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770da1e4-2749-487a-aa43-ac38740b0247(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:05:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6ef4ddc4-5857-442a-9b72-7cec5ab836f7 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.bd4b7da2-730e-49c7-8672-e20f10c1c681 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:05:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:05:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:05:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:05:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:05:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:05:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:49 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.bd4b7da2-730e-49c7-8672-e20f10c1c681 1G Sep 05 05:05:49 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:49 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:05:49 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:49 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.298s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:49 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:05:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager._thread_info {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:05:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread count: 8 {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 05:05:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread info: [<_MainThread(MainThread, started 139182109970560)>, , , , , , , ] {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 05:05:50 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6ef4ddc4-5857-442a-9b72-7cec5ab836f7 tempest-SnapshotsActionsTest-914703108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.bd4b7da2-730e-49c7-8672-e20f10c1c681 1G" returned: 0 in 0.539s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6ef4ddc4-5857-442a-9b72-7cec5ab836f7 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.bd4b7da2-730e-49c7-8672-e20f10c1c681 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:50 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.bd4b7da2-730e-49c7-8672-e20f10c1c681 Sep 05 05:05:50 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:50 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6ef4ddc4-5857-442a-9b72-7cec5ab836f7 tempest-SnapshotsActionsTest-914703108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.bd4b7da2-730e-49c7-8672-e20f10c1c681" returned: 0 in 0.294s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:50 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-6ef4ddc4-5857-442a-9b72-7cec5ab836f7 tempest-SnapshotsActionsTest-914703108 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.bd4b7da2-730e-49c7-8672-e20f10c1c681 is being set with open permissions: ugo+rw Sep 05 05:05:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6ef4ddc4-5857-442a-9b72-7cec5ab836f7 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.bd4b7da2-730e-49c7-8672-e20f10c1c681 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:50 devstack sudo[95039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.bd4b7da2-730e-49c7-8672-e20f10c1c681 Sep 05 05:05:50 devstack sudo[95039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:50 devstack sudo[95039]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6ef4ddc4-5857-442a-9b72-7cec5ab836f7 tempest-SnapshotsActionsTest-914703108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.bd4b7da2-730e-49c7-8672-e20f10c1c681" returned: 0 in 0.249s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6ef4ddc4-5857-442a-9b72-7cec5ab836f7 tempest-SnapshotsActionsTest-914703108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.588s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:05:50 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-6ef4ddc4-5857-442a-9b72-7cec5ab836f7 tempest-SnapshotsActionsTest-914703108 None] Create snapshot completed successfully Sep 05 05:05:51 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-41991f64-9c4b-4d12-8979-6fb9224f7476 tempest-SnapshotsActionsTest-1650159530 None] Acquiring lock "cinder-bd4b7da2-730e-49c7-8672-e20f10c1c681-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:05:51 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-41991f64-9c4b-4d12-8979-6fb9224f7476 tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-bd4b7da2-730e-49c7-8672-e20f10c1c681-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:05:51 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-41991f64-9c4b-4d12-8979-6fb9224f7476 tempest-SnapshotsActionsTest-1650159530 None] Acquiring lock "cinder-quobyte-770da1e4-2749-487a-aa43-ac38740b0247" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:05:51 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-41991f64-9c4b-4d12-8979-6fb9224f7476 tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-quobyte-770da1e4-2749-487a-aa43-ac38740b0247" acquired by "delete_snapshot" :: waited 0.045s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:05:51 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-41991f64-9c4b-4d12-8979-6fb9224f7476 tempest-SnapshotsActionsTest-1650159530 None] Acquiring lock "cinder-quobyte-bd4b7da2-730e-49c7-8672-e20f10c1c681" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:05:51 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-41991f64-9c4b-4d12-8979-6fb9224f7476 tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-quobyte-bd4b7da2-730e-49c7-8672-e20f10c1c681" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:05:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-41991f64-9c4b-4d12-8979-6fb9224f7476 tempest-SnapshotsActionsTest-1650159530 None] Deleting offline snapshot bd4b7da2-730e-49c7-8672-e20f10c1c681 of volume 770da1e4-2749-487a-aa43-ac38740b0247 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:05:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-41991f64-9c4b-4d12-8979-6fb9224f7476 tempest-SnapshotsActionsTest-1650159530 None] snapshot_file for this snap is: volume-770da1e4-2749-487a-aa43-ac38740b0247.bd4b7da2-730e-49c7-8672-e20f10c1c681 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:05:51 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4211406d-746d-4045-ac39-563ecabfa0a5]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:05:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-41991f64-9c4b-4d12-8979-6fb9224f7476 tempest-SnapshotsActionsTest-1650159530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.bd4b7da2-730e-49c7-8672-e20f10c1c681 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:51 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.bd4b7da2-730e-49c7-8672-e20f10c1c681 Sep 05 05:05:51 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:51 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-41991f64-9c4b-4d12-8979-6fb9224f7476 tempest-SnapshotsActionsTest-1650159530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.bd4b7da2-730e-49c7-8672-e20f10c1c681" returned: 0 in 0.468s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-41991f64-9c4b-4d12-8979-6fb9224f7476 tempest-SnapshotsActionsTest-1650159530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770da1e4-2749-487a-aa43-ac38740b0247(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:05:52 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97690ff-14e0-435d-9442-24ee9dd32e6e]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:05:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-41991f64-9c4b-4d12-8979-6fb9224f7476 tempest-SnapshotsActionsTest-1650159530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:52 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 Sep 05 05:05:52 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:52 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-41991f64-9c4b-4d12-8979-6fb9224f7476 tempest-SnapshotsActionsTest-1650159530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5" returned: 0 in 0.385s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-41991f64-9c4b-4d12-8979-6fb9224f7476 tempest-SnapshotsActionsTest-1650159530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770da1e4-2749-487a-aa43-ac38740b0247(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:05:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-41991f64-9c4b-4d12-8979-6fb9224f7476 tempest-SnapshotsActionsTest-1650159530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.bd4b7da2-730e-49c7-8672-e20f10c1c681 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:52 devstack sudo[95093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.bd4b7da2-730e-49c7-8672-e20f10c1c681 Sep 05 05:05:52 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:52 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-41991f64-9c4b-4d12-8979-6fb9224f7476 tempest-SnapshotsActionsTest-1650159530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.bd4b7da2-730e-49c7-8672-e20f10c1c681" returned: 0 in 0.369s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-41991f64-9c4b-4d12-8979-6fb9224f7476 tempest-SnapshotsActionsTest-1650159530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.bd4b7da2-730e-49c7-8672-e20f10c1c681 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:52 devstack sudo[95101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.bd4b7da2-730e-49c7-8672-e20f10c1c681 Sep 05 05:05:52 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:53 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-41991f64-9c4b-4d12-8979-6fb9224f7476 tempest-SnapshotsActionsTest-1650159530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.bd4b7da2-730e-49c7-8672-e20f10c1c681" returned: 0 in 0.246s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:53 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-41991f64-9c4b-4d12-8979-6fb9224f7476 tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-quobyte-bd4b7da2-730e-49c7-8672-e20f10c1c681" released by "_delete_snapshot" :: held 1.571s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:05:53 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-41991f64-9c4b-4d12-8979-6fb9224f7476 tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-quobyte-770da1e4-2749-487a-aa43-ac38740b0247" released by "delete_snapshot" :: held 1.600s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:05:53 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-41991f64-9c4b-4d12-8979-6fb9224f7476 tempest-SnapshotsActionsTest-1650159530 None] Created reservations ['fbdcb44b-c938-413d-9d48-d6785d404cf6', 'a2d3452e-4d59-4140-9603-dc72b9be7f68', '759c5f68-a6c7-407e-aa63-94c220144183', 'b950be92-9069-4afd-9565-4bafa661dcff'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:05:53 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-41991f64-9c4b-4d12-8979-6fb9224f7476 tempest-SnapshotsActionsTest-1650159530 None] Delete snapshot completed successfully. Sep 05 05:05:53 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-41991f64-9c4b-4d12-8979-6fb9224f7476 tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-bd4b7da2-730e-49c7-8672-e20f10c1c681-delete_snapshot" released by "delete_snapshot" :: held 1.783s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:05:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7dff95b8-4e6f-4393-b9b8-476b7af0cf84 tempest-SnapshotsActionsTest-914703108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:05:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7dff95b8-4e6f-4393-b9b8-476b7af0cf84 tempest-SnapshotsActionsTest-914703108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:05:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-7dff95b8-4e6f-4393-b9b8-476b7af0cf84 tempest-SnapshotsActionsTest-914703108 None] Creating offline snapshot 9c783651-fb18-4c5c-804f-910e47061cd4 of volume 770da1e4-2749-487a-aa43-ac38740b0247 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:05:53 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4ac0fc-e9aa-4ad2-9ad2-eae07ad469ed]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:05:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7dff95b8-4e6f-4393-b9b8-476b7af0cf84 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:54 devstack sudo[95104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 Sep 05 05:05:54 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:54 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7dff95b8-4e6f-4393-b9b8-476b7af0cf84 tempest-SnapshotsActionsTest-914703108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5" returned: 0 in 0.375s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-7dff95b8-4e6f-4393-b9b8-476b7af0cf84 tempest-SnapshotsActionsTest-914703108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770da1e4-2749-487a-aa43-ac38740b0247(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:05:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7dff95b8-4e6f-4393-b9b8-476b7af0cf84 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.9c783651-fb18-4c5c-804f-910e47061cd4 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:54 devstack sudo[95110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.9c783651-fb18-4c5c-804f-910e47061cd4 1G Sep 05 05:05:54 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:54 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7dff95b8-4e6f-4393-b9b8-476b7af0cf84 tempest-SnapshotsActionsTest-914703108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.9c783651-fb18-4c5c-804f-910e47061cd4 1G" returned: 0 in 0.419s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7dff95b8-4e6f-4393-b9b8-476b7af0cf84 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.9c783651-fb18-4c5c-804f-910e47061cd4 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:54 devstack sudo[95115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.9c783651-fb18-4c5c-804f-910e47061cd4 Sep 05 05:05:54 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:55 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7dff95b8-4e6f-4393-b9b8-476b7af0cf84 tempest-SnapshotsActionsTest-914703108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.9c783651-fb18-4c5c-804f-910e47061cd4" returned: 0 in 0.306s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:55 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-7dff95b8-4e6f-4393-b9b8-476b7af0cf84 tempest-SnapshotsActionsTest-914703108 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.9c783651-fb18-4c5c-804f-910e47061cd4 is being set with open permissions: ugo+rw Sep 05 05:05:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7dff95b8-4e6f-4393-b9b8-476b7af0cf84 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.9c783651-fb18-4c5c-804f-910e47061cd4 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:55 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.9c783651-fb18-4c5c-804f-910e47061cd4 Sep 05 05:05:55 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:55 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7dff95b8-4e6f-4393-b9b8-476b7af0cf84 tempest-SnapshotsActionsTest-914703108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.9c783651-fb18-4c5c-804f-910e47061cd4" returned: 0 in 0.258s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7dff95b8-4e6f-4393-b9b8-476b7af0cf84 tempest-SnapshotsActionsTest-914703108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.463s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:05:55 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-7dff95b8-4e6f-4393-b9b8-476b7af0cf84 tempest-SnapshotsActionsTest-914703108 None] Create snapshot completed successfully Sep 05 05:05:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7a5ab937-3f39-441a-b67f-375e2765f3e5 tempest-SnapshotsActionsTest-1650159530 None] Acquiring lock "cinder-9c783651-fb18-4c5c-804f-910e47061cd4-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:05:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7a5ab937-3f39-441a-b67f-375e2765f3e5 tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-9c783651-fb18-4c5c-804f-910e47061cd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:05:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7a5ab937-3f39-441a-b67f-375e2765f3e5 tempest-SnapshotsActionsTest-1650159530 None] Acquiring lock "cinder-quobyte-770da1e4-2749-487a-aa43-ac38740b0247" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:05:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7a5ab937-3f39-441a-b67f-375e2765f3e5 tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-quobyte-770da1e4-2749-487a-aa43-ac38740b0247" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:05:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7a5ab937-3f39-441a-b67f-375e2765f3e5 tempest-SnapshotsActionsTest-1650159530 None] Acquiring lock "cinder-quobyte-9c783651-fb18-4c5c-804f-910e47061cd4" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:05:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7a5ab937-3f39-441a-b67f-375e2765f3e5 tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-quobyte-9c783651-fb18-4c5c-804f-910e47061cd4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:05:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-7a5ab937-3f39-441a-b67f-375e2765f3e5 tempest-SnapshotsActionsTest-1650159530 None] Deleting offline snapshot 9c783651-fb18-4c5c-804f-910e47061cd4 of volume 770da1e4-2749-487a-aa43-ac38740b0247 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:05:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-7a5ab937-3f39-441a-b67f-375e2765f3e5 tempest-SnapshotsActionsTest-1650159530 None] snapshot_file for this snap is: volume-770da1e4-2749-487a-aa43-ac38740b0247.9c783651-fb18-4c5c-804f-910e47061cd4 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:05:56 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdf2700-2cc9-476c-9f18-fbe88c0986e4]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:05:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a5ab937-3f39-441a-b67f-375e2765f3e5 tempest-SnapshotsActionsTest-1650159530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.9c783651-fb18-4c5c-804f-910e47061cd4 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:56 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.9c783651-fb18-4c5c-804f-910e47061cd4 Sep 05 05:05:56 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:56 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a5ab937-3f39-441a-b67f-375e2765f3e5 tempest-SnapshotsActionsTest-1650159530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.9c783651-fb18-4c5c-804f-910e47061cd4" returned: 0 in 0.372s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-7a5ab937-3f39-441a-b67f-375e2765f3e5 tempest-SnapshotsActionsTest-1650159530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770da1e4-2749-487a-aa43-ac38740b0247(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:05:56 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[486d8891-b871-4a19-8c8c-c017e9408296]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:05:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a5ab937-3f39-441a-b67f-375e2765f3e5 tempest-SnapshotsActionsTest-1650159530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:56 devstack sudo[95150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 Sep 05 05:05:56 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:57 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a5ab937-3f39-441a-b67f-375e2765f3e5 tempest-SnapshotsActionsTest-1650159530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5" returned: 0 in 0.385s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-7a5ab937-3f39-441a-b67f-375e2765f3e5 tempest-SnapshotsActionsTest-1650159530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770da1e4-2749-487a-aa43-ac38740b0247(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:05:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a5ab937-3f39-441a-b67f-375e2765f3e5 tempest-SnapshotsActionsTest-1650159530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.9c783651-fb18-4c5c-804f-910e47061cd4 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:57 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.9c783651-fb18-4c5c-804f-910e47061cd4 Sep 05 05:05:57 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:57 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a5ab937-3f39-441a-b67f-375e2765f3e5 tempest-SnapshotsActionsTest-1650159530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.9c783651-fb18-4c5c-804f-910e47061cd4" returned: 0 in 0.388s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a5ab937-3f39-441a-b67f-375e2765f3e5 tempest-SnapshotsActionsTest-1650159530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.9c783651-fb18-4c5c-804f-910e47061cd4 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:57 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.9c783651-fb18-4c5c-804f-910e47061cd4 Sep 05 05:05:57 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:57 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a5ab937-3f39-441a-b67f-375e2765f3e5 tempest-SnapshotsActionsTest-1650159530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.9c783651-fb18-4c5c-804f-910e47061cd4" returned: 0 in 0.255s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7a5ab937-3f39-441a-b67f-375e2765f3e5 tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-quobyte-9c783651-fb18-4c5c-804f-910e47061cd4" released by "_delete_snapshot" :: held 1.483s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:05:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7a5ab937-3f39-441a-b67f-375e2765f3e5 tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-quobyte-770da1e4-2749-487a-aa43-ac38740b0247" released by "delete_snapshot" :: held 1.506s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:05:57 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-7a5ab937-3f39-441a-b67f-375e2765f3e5 tempest-SnapshotsActionsTest-1650159530 None] Created reservations ['047e1dfc-27ef-4519-83c8-a92b3855681d', '419c39d3-a6b4-43dd-8ae4-1f557cbee045', '7b85781d-05bd-4a73-a622-c7a47fa339cb', '0aa7301f-be00-43ca-a244-c5ea772cb8d3'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:05:57 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-7a5ab937-3f39-441a-b67f-375e2765f3e5 tempest-SnapshotsActionsTest-1650159530 None] Delete snapshot completed successfully. Sep 05 05:05:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7a5ab937-3f39-441a-b67f-375e2765f3e5 tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-9c783651-fb18-4c5c-804f-910e47061cd4-delete_snapshot" released by "delete_snapshot" :: held 1.638s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:05:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4fee6554-f0b0-467e-ac3c-153426dd2ee3 tempest-SnapshotsActionsTest-914703108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:05:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4fee6554-f0b0-467e-ac3c-153426dd2ee3 tempest-SnapshotsActionsTest-914703108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:05:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-4fee6554-f0b0-467e-ac3c-153426dd2ee3 tempest-SnapshotsActionsTest-914703108 None] Creating offline snapshot a650be2a-893f-40c7-b755-dc8fceb72ceb of volume 770da1e4-2749-487a-aa43-ac38740b0247 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:05:58 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3444ddb-ac28-4b2f-96bb-5b8645c8e718]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:05:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4fee6554-f0b0-467e-ac3c-153426dd2ee3 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:58 devstack sudo[95175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 Sep 05 05:05:58 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:59 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4fee6554-f0b0-467e-ac3c-153426dd2ee3 tempest-SnapshotsActionsTest-914703108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5" returned: 0 in 0.382s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:59 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-4fee6554-f0b0-467e-ac3c-153426dd2ee3 tempest-SnapshotsActionsTest-914703108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770da1e4-2749-487a-aa43-ac38740b0247(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:05:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4fee6554-f0b0-467e-ac3c-153426dd2ee3 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.a650be2a-893f-40c7-b755-dc8fceb72ceb 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:59 devstack sudo[95181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.a650be2a-893f-40c7-b755-dc8fceb72ceb 1G Sep 05 05:05:59 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:59 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-1ffc3b41-9a0b-4c83-ae18-66942f504418 req-c7385c73-c5d0-49b4-9cd4-2181d2ffff0d tempest-ServerActionsTestOtherA-74061543 None] Terminate volume connection completed successfully. Sep 05 05:05:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-1ffc3b41-9a0b-4c83-ae18-66942f504418 req-c7385c73-c5d0-49b4-9cd4-2181d2ffff0d tempest-ServerActionsTestOtherA-74061543 None] Deleting attachment fbd4d8f9-ab05-47c7-90c6-80d5d6f40c44. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:05:59 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4fee6554-f0b0-467e-ac3c-153426dd2ee3 tempest-SnapshotsActionsTest-914703108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.a650be2a-893f-40c7-b755-dc8fceb72ceb 1G" returned: 0 in 0.461s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4fee6554-f0b0-467e-ac3c-153426dd2ee3 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.a650be2a-893f-40c7-b755-dc8fceb72ceb {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:59 devstack sudo[95191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.a650be2a-893f-40c7-b755-dc8fceb72ceb Sep 05 05:05:59 devstack sudo[95191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:05:59 devstack sudo[95191]: pam_unix(sudo:session): session closed for user root Sep 05 05:05:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4fee6554-f0b0-467e-ac3c-153426dd2ee3 tempest-SnapshotsActionsTest-914703108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.a650be2a-893f-40c7-b755-dc8fceb72ceb" returned: 0 in 0.295s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:05:59 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-4fee6554-f0b0-467e-ac3c-153426dd2ee3 tempest-SnapshotsActionsTest-914703108 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.a650be2a-893f-40c7-b755-dc8fceb72ceb is being set with open permissions: ugo+rw Sep 05 05:05:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4fee6554-f0b0-467e-ac3c-153426dd2ee3 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.a650be2a-893f-40c7-b755-dc8fceb72ceb {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:05:59 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.a650be2a-893f-40c7-b755-dc8fceb72ceb Sep 05 05:05:59 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:00 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4fee6554-f0b0-467e-ac3c-153426dd2ee3 tempest-SnapshotsActionsTest-914703108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.a650be2a-893f-40c7-b755-dc8fceb72ceb" returned: 0 in 0.240s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4fee6554-f0b0-467e-ac3c-153426dd2ee3 tempest-SnapshotsActionsTest-914703108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.475s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:00 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-4fee6554-f0b0-467e-ac3c-153426dd2ee3 tempest-SnapshotsActionsTest-914703108 None] Create snapshot completed successfully Sep 05 05:06:00 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9ace4c70-1a7e-4aeb-ad7e-4ee61f64ae97 tempest-SnapshotsActionsTest-1650159530 None] Acquiring lock "cinder-a650be2a-893f-40c7-b755-dc8fceb72ceb-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:06:00 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9ace4c70-1a7e-4aeb-ad7e-4ee61f64ae97 tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-a650be2a-893f-40c7-b755-dc8fceb72ceb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:06:00 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9ace4c70-1a7e-4aeb-ad7e-4ee61f64ae97 tempest-SnapshotsActionsTest-1650159530 None] Acquiring lock "cinder-quobyte-770da1e4-2749-487a-aa43-ac38740b0247" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:06:00 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9ace4c70-1a7e-4aeb-ad7e-4ee61f64ae97 tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-quobyte-770da1e4-2749-487a-aa43-ac38740b0247" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:06:00 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9ace4c70-1a7e-4aeb-ad7e-4ee61f64ae97 tempest-SnapshotsActionsTest-1650159530 None] Acquiring lock "cinder-quobyte-a650be2a-893f-40c7-b755-dc8fceb72ceb" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:06:00 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9ace4c70-1a7e-4aeb-ad7e-4ee61f64ae97 tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-quobyte-a650be2a-893f-40c7-b755-dc8fceb72ceb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:06:00 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-9ace4c70-1a7e-4aeb-ad7e-4ee61f64ae97 tempest-SnapshotsActionsTest-1650159530 None] Deleting offline snapshot a650be2a-893f-40c7-b755-dc8fceb72ceb of volume 770da1e4-2749-487a-aa43-ac38740b0247 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:06:00 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-9ace4c70-1a7e-4aeb-ad7e-4ee61f64ae97 tempest-SnapshotsActionsTest-1650159530 None] snapshot_file for this snap is: volume-770da1e4-2749-487a-aa43-ac38740b0247.a650be2a-893f-40c7-b755-dc8fceb72ceb {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:06:00 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee6ca0d-8c65-4ca2-8365-61616dd987e2]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:06:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9ace4c70-1a7e-4aeb-ad7e-4ee61f64ae97 tempest-SnapshotsActionsTest-1650159530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.a650be2a-893f-40c7-b755-dc8fceb72ceb {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:01 devstack sudo[95223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.a650be2a-893f-40c7-b755-dc8fceb72ceb Sep 05 05:06:01 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:01 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9ace4c70-1a7e-4aeb-ad7e-4ee61f64ae97 tempest-SnapshotsActionsTest-1650159530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.a650be2a-893f-40c7-b755-dc8fceb72ceb" returned: 0 in 0.397s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-9ace4c70-1a7e-4aeb-ad7e-4ee61f64ae97 tempest-SnapshotsActionsTest-1650159530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770da1e4-2749-487a-aa43-ac38740b0247(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:06:01 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67a18ae-a97f-4a13-a198-c19d8c8340ce]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:06:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9ace4c70-1a7e-4aeb-ad7e-4ee61f64ae97 tempest-SnapshotsActionsTest-1650159530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:01 devstack sudo[95228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 Sep 05 05:06:01 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:01 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9ace4c70-1a7e-4aeb-ad7e-4ee61f64ae97 tempest-SnapshotsActionsTest-1650159530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5" returned: 0 in 0.524s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-9ace4c70-1a7e-4aeb-ad7e-4ee61f64ae97 tempest-SnapshotsActionsTest-1650159530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770da1e4-2749-487a-aa43-ac38740b0247(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:06:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9ace4c70-1a7e-4aeb-ad7e-4ee61f64ae97 tempest-SnapshotsActionsTest-1650159530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.a650be2a-893f-40c7-b755-dc8fceb72ceb {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:02 devstack sudo[95235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.a650be2a-893f-40c7-b755-dc8fceb72ceb Sep 05 05:06:02 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:02 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9ace4c70-1a7e-4aeb-ad7e-4ee61f64ae97 tempest-SnapshotsActionsTest-1650159530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.a650be2a-893f-40c7-b755-dc8fceb72ceb" returned: 0 in 0.477s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9ace4c70-1a7e-4aeb-ad7e-4ee61f64ae97 tempest-SnapshotsActionsTest-1650159530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.a650be2a-893f-40c7-b755-dc8fceb72ceb {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:02 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.a650be2a-893f-40c7-b755-dc8fceb72ceb Sep 05 05:06:02 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:02 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9ace4c70-1a7e-4aeb-ad7e-4ee61f64ae97 tempest-SnapshotsActionsTest-1650159530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.a650be2a-893f-40c7-b755-dc8fceb72ceb" returned: 0 in 0.290s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:02 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9ace4c70-1a7e-4aeb-ad7e-4ee61f64ae97 tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-quobyte-a650be2a-893f-40c7-b755-dc8fceb72ceb" released by "_delete_snapshot" :: held 1.815s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:06:02 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9ace4c70-1a7e-4aeb-ad7e-4ee61f64ae97 tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-quobyte-770da1e4-2749-487a-aa43-ac38740b0247" released by "delete_snapshot" :: held 1.840s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:06:02 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-9ace4c70-1a7e-4aeb-ad7e-4ee61f64ae97 tempest-SnapshotsActionsTest-1650159530 None] Created reservations ['769e48cf-b518-4eef-9eaf-080d5edc4a48', 'f94b09e2-e8b0-4875-8d72-0e6696f794f0', '30999448-eacf-4c64-96ec-c643662e8077', '0cd0c5a5-ee95-473f-8729-e2baae324a3b'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:06:02 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-9ace4c70-1a7e-4aeb-ad7e-4ee61f64ae97 tempest-SnapshotsActionsTest-1650159530 None] Delete snapshot completed successfully. Sep 05 05:06:02 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9ace4c70-1a7e-4aeb-ad7e-4ee61f64ae97 tempest-SnapshotsActionsTest-1650159530 None] Lock "cinder-a650be2a-893f-40c7-b755-dc8fceb72ceb-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:06:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ccc2afdf-538b-4eed-b2d6-b9868fd7f260 tempest-SnapshotsActionsTest-914703108 None] Acquiring lock "cinder-3b6a962d-79bd-4ee8-bdc0-a370e81964c5-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:06:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ccc2afdf-538b-4eed-b2d6-b9868fd7f260 tempest-SnapshotsActionsTest-914703108 None] Lock "cinder-3b6a962d-79bd-4ee8-bdc0-a370e81964c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:06:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ccc2afdf-538b-4eed-b2d6-b9868fd7f260 tempest-SnapshotsActionsTest-914703108 None] Acquiring lock "cinder-quobyte-770da1e4-2749-487a-aa43-ac38740b0247" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:06:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ccc2afdf-538b-4eed-b2d6-b9868fd7f260 tempest-SnapshotsActionsTest-914703108 None] Lock "cinder-quobyte-770da1e4-2749-487a-aa43-ac38740b0247" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:06:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ccc2afdf-538b-4eed-b2d6-b9868fd7f260 tempest-SnapshotsActionsTest-914703108 None] Acquiring lock "cinder-quobyte-3b6a962d-79bd-4ee8-bdc0-a370e81964c5" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:06:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ccc2afdf-538b-4eed-b2d6-b9868fd7f260 tempest-SnapshotsActionsTest-914703108 None] Lock "cinder-quobyte-3b6a962d-79bd-4ee8-bdc0-a370e81964c5" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:06:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-ccc2afdf-538b-4eed-b2d6-b9868fd7f260 tempest-SnapshotsActionsTest-914703108 None] Deleting offline snapshot 3b6a962d-79bd-4ee8-bdc0-a370e81964c5 of volume 770da1e4-2749-487a-aa43-ac38740b0247 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:06:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-ccc2afdf-538b-4eed-b2d6-b9868fd7f260 tempest-SnapshotsActionsTest-914703108 None] snapshot_file for this snap is: volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:06:03 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c11d78-1a95-4bbb-bccd-4f215cf35651]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:06:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ccc2afdf-538b-4eed-b2d6-b9868fd7f260 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:03 devstack sudo[95246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 Sep 05 05:06:03 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:04 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ccc2afdf-538b-4eed-b2d6-b9868fd7f260 tempest-SnapshotsActionsTest-914703108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5" returned: 0 in 0.435s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-ccc2afdf-538b-4eed-b2d6-b9868fd7f260 tempest-SnapshotsActionsTest-914703108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770da1e4-2749-487a-aa43-ac38740b0247(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:06:04 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b583ef-3ed9-421e-8a04-618ea75ee110]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:06:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ccc2afdf-538b-4eed-b2d6-b9868fd7f260 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:04 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247 Sep 05 05:06:04 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:04 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ccc2afdf-538b-4eed-b2d6-b9868fd7f260 tempest-SnapshotsActionsTest-914703108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247" returned: 0 in 0.394s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ccc2afdf-538b-4eed-b2d6-b9868fd7f260 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:04 devstack sudo[95256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 Sep 05 05:06:04 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:04 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ccc2afdf-538b-4eed-b2d6-b9868fd7f260 tempest-SnapshotsActionsTest-914703108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5" returned: 0 in 0.397s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ccc2afdf-538b-4eed-b2d6-b9868fd7f260 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:04 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5 Sep 05 05:06:04 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:05 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ccc2afdf-538b-4eed-b2d6-b9868fd7f260 tempest-SnapshotsActionsTest-914703108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247.3b6a962d-79bd-4ee8-bdc0-a370e81964c5" returned: 0 in 0.253s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ccc2afdf-538b-4eed-b2d6-b9868fd7f260 tempest-SnapshotsActionsTest-914703108 None] Lock "cinder-quobyte-3b6a962d-79bd-4ee8-bdc0-a370e81964c5" released by "_delete_snapshot" :: held 1.621s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:06:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ccc2afdf-538b-4eed-b2d6-b9868fd7f260 tempest-SnapshotsActionsTest-914703108 None] Lock "cinder-quobyte-770da1e4-2749-487a-aa43-ac38740b0247" released by "delete_snapshot" :: held 1.660s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:06:05 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-ccc2afdf-538b-4eed-b2d6-b9868fd7f260 tempest-SnapshotsActionsTest-914703108 None] Created reservations ['124b2162-23f2-44d8-9fc3-bbd226e3d59f', '0ae2d801-4e2f-482a-a04f-590c42671fa7', '9b4bac5e-8f33-458d-ac00-bb5857c6857d', 'bc16c7d5-863c-4773-8010-a5095fd78b11'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:06:05 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ccc2afdf-538b-4eed-b2d6-b9868fd7f260 tempest-SnapshotsActionsTest-914703108 None] Delete snapshot completed successfully. Sep 05 05:06:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ccc2afdf-538b-4eed-b2d6-b9868fd7f260 tempest-SnapshotsActionsTest-914703108 None] Lock "cinder-3b6a962d-79bd-4ee8-bdc0-a370e81964c5-delete_snapshot" released by "delete_snapshot" :: held 1.872s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:06:05 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:06:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Flow 'volume_create_manager' (8fdb0295-8735-46f7-bfc3-3128dfd84625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:06:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53eef823-739b-4945-bc2f-d6c4dd91de34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53eef823-739b-4945-bc2f-d6c4dd91de34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-301903845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5913549-be6d-4464-b9cc-8e4ff6f7d17e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5e1c7cc5684fb0aa20ef92be4afdb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:06:05Z,use_quota=True,user_id='d71c0e8e09ee4d00a6a9e78503f79464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e613375e-d46b-490b-9d8a-14f870711b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e613375e-d46b-490b-9d8a-14f870711b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a79e6fb-4c7f-4005-97e4-8433746b5ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:05 devstack cinder-volume[89331]: DEBUG cinder.image.glance [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Creating Keystone auth plugin from conf {{(pid=89331) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 05:06:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b24d7b4b-1599-45ac-a47a-8670cdf835b3 tempest-SnapshotsActionsTest-914703108 None] Acquiring lock "cinder-770da1e4-2749-487a-aa43-ac38740b0247-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:06:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b24d7b4b-1599-45ac-a47a-8670cdf835b3 tempest-SnapshotsActionsTest-914703108 None] Lock "cinder-770da1e4-2749-487a-aa43-ac38740b0247-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:06:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b24d7b4b-1599-45ac-a47a-8670cdf835b3 tempest-SnapshotsActionsTest-914703108 None] Acquiring lock "cinder-quobyte-770da1e4-2749-487a-aa43-ac38740b0247" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:06:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b24d7b4b-1599-45ac-a47a-8670cdf835b3 tempest-SnapshotsActionsTest-914703108 None] Lock "cinder-quobyte-770da1e4-2749-487a-aa43-ac38740b0247" acquired by "delete_volume" :: waited 0.016s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[446daa17-0bd5-4657-b89c-940085e03e7b]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b24d7b4b-1599-45ac-a47a-8670cdf835b3 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a79e6fb-4c7f-4005-97e4-8433746b5ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e5913549-be6d-4464-b9cc-8e4ff6f7d17e', 'volume_name': 'volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e', 'volume_size': 1, 'image_id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '06b067117d184688bd2e16e21ff323f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'created_at': datetime.datetime(2026, 9, 5, 2, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 55, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a8bfe9-6d4d-45af-a6ae-053b36e47b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a8bfe9-6d4d-45af-a6ae-053b36e47b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (641c1ede-0209-4875-b57e-fcc83f0053bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:06 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Volume e5913549-be6d-4464-b9cc-8e4ff6f7d17e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e', 'volume_size': 1, 'image_id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '06b067117d184688bd2e16e21ff323f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'created_at': datetime.datetime(2026, 9, 5, 2, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 55, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Trying to clone e5913549-be6d-4464-b9cc-8e4ff6f7d17e from image a60f4e58-9471-4dd7-bff3-114bdbd77a8d at location (None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}]). {{(pid=89331) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 05:06:06 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247 Sep 05 05:06:06 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Flow 'volume_create_manager' (fa0c8230-50ca-4cfe-889b-8cfec0bf566a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47e594d-7e23-4ac8-9295-8dc35e9ce57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47e594d-7e23-4ac8-9295-8dc35e9ce57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2138990835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9293273-1223-45b8-bc5b-a5348c4527db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16cf223fa3e466096a97a3f568b8094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:06:06Z,use_quota=True,user_id='7210a9b8a9c54e46a15a82e0c7fd829b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4da3574-b4c2-4b30-903a-6659d27dd026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4da3574-b4c2-4b30-903a-6659d27dd026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f578ba8-632c-421a-b84e-792393013e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f578ba8-632c-421a-b84e-792393013e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9293273-1223-45b8-bc5b-a5348c4527db', 'volume_name': 'volume-d9293273-1223-45b8-bc5b-a5348c4527db', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (463387e8-8f48-47ea-8627-0ef93314d41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (463387e8-8f48-47ea-8627-0ef93314d41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a1326d-d4dd-488f-95a7-efa444cef651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:06 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Volume d9293273-1223-45b8-bc5b-a5348c4527db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9293273-1223-45b8-bc5b-a5348c4527db', 'volume_size': 1} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2138990835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9293273-1223-45b8-bc5b-a5348c4527db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16cf223fa3e466096a97a3f568b8094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:06:06Z,use_quota=True,user_id='7210a9b8a9c54e46a15a82e0c7fd829b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Creating volume d9293273-1223-45b8-bc5b-a5348c4527db {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:06:06 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9293273-1223-45b8-bc5b-a5348c4527db 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:06 devstack sudo[95270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9293273-1223-45b8-bc5b-a5348c4527db 1073741824 Sep 05 05:06:06 devstack sudo[95270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:06 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b24d7b4b-1599-45ac-a47a-8670cdf835b3 tempest-SnapshotsActionsTest-914703108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247" returned: 0 in 0.499s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b24d7b4b-1599-45ac-a47a-8670cdf835b3 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:06 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247 Sep 05 05:06:06 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_9ihk152adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 05:06:06 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Image download 20.69 MB at 20.69 MB/s Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbed042-f68a-46e5-9161-760b7c3a12ba]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_9ihk152adevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:06 devstack sudo[95270]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9293273-1223-45b8-bc5b-a5348c4527db 1073741824" returned: 0 in 0.543s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:06 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_9ihk152adevstack@QuobyteHD Sep 05 05:06:06 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:06 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b24d7b4b-1599-45ac-a47a-8670cdf835b3 tempest-SnapshotsActionsTest-914703108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-770da1e4-2749-487a-aa43-ac38740b0247" returned: 0 in 0.351s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b24d7b4b-1599-45ac-a47a-8670cdf835b3 tempest-SnapshotsActionsTest-914703108 None] Lock "cinder-quobyte-770da1e4-2749-487a-aa43-ac38740b0247" released by "delete_volume" :: held 0.932s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9293273-1223-45b8-bc5b-a5348c4527db {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:06 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9293273-1223-45b8-bc5b-a5348c4527db Sep 05 05:06:06 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:06 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-b24d7b4b-1599-45ac-a47a-8670cdf835b3 tempest-SnapshotsActionsTest-914703108 None] Created reservations ['d89eb924-0f9a-4fd6-bd07-dea4ed3d118e', '919945fe-f8f8-4959-9c4f-1190aa13c236', '5d8baff1-2c8f-4a4e-95eb-fc63ecc05d87', '49daae7a-49a8-4bb7-8497-d6350fe32ca6'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b24d7b4b-1599-45ac-a47a-8670cdf835b3 tempest-SnapshotsActionsTest-914703108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b24d7b4b-1599-45ac-a47a-8670cdf835b3 tempest-SnapshotsActionsTest-914703108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b24d7b4b-1599-45ac-a47a-8670cdf835b3 tempest-SnapshotsActionsTest-914703108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b24d7b4b-1599-45ac-a47a-8670cdf835b3 tempest-SnapshotsActionsTest-914703108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b24d7b4b-1599-45ac-a47a-8670cdf835b3 tempest-SnapshotsActionsTest-914703108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b24d7b4b-1599-45ac-a47a-8670cdf835b3 tempest-SnapshotsActionsTest-914703108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:07 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:06:07 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:07 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_9ihk152adevstack@QuobyteHD" returned: 0 in 0.512s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Temporary image a60f4e58-9471-4dd7-bff3-114bdbd77a8d is fetched for user d71c0e8e09ee4d00a6a9e78503f79464. {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Flow 'volume_create_manager' (3cecc31f-203d-47a2-bfb4-8568c2dd10a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd106651-3e4e-4919-969d-58623813900c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:07 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd106651-3e4e-4919-969d-58623813900c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-317833940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9578942-9108-41b9-8746-09fc3d4a132f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a69f0622a0874d20a86028e75af9fb59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:06:07Z,use_quota=True,user_id='55532b8573ab45f98b984cd26de1bc49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3827e498-b06a-418c-a5dd-56ad22728016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3827e498-b06a-418c-a5dd-56ad22728016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a91c56-2194-4d8c-90d3-4a5ef17f83fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a91c56-2194-4d8c-90d3-4a5ef17f83fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9578942-9108-41b9-8746-09fc3d4a132f', 'volume_name': 'volume-d9578942-9108-41b9-8746-09fc3d4a132f', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b42e514-640d-4b03-b9b7-6c0d19ee2b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b42e514-640d-4b03-b9b7-6c0d19ee2b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c96f776-3624-42f6-9c88-128a84f4a4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:07 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Volume d9578942-9108-41b9-8746-09fc3d4a132f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9578942-9108-41b9-8746-09fc3d4a132f', 'volume_size': 1} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9293273-1223-45b8-bc5b-a5348c4527db" returned: 0 in 0.413s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-317833940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9578942-9108-41b9-8746-09fc3d4a132f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a69f0622a0874d20a86028e75af9fb59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:06:07Z,use_quota=True,user_id='55532b8573ab45f98b984cd26de1bc49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Creating volume d9578942-9108-41b9-8746-09fc3d4a132f {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:06:07 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9578942-9108-41b9-8746-09fc3d4a132f 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a1326d-d4dd-488f-95a7-efa444cef651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9293273-1223-45b8-bc5b-a5348c4527db', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:07 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9578942-9108-41b9-8746-09fc3d4a132f 1073741824 Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a5a3e8b-5f24-437a-92b0-0740fec18e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:07 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:07 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b24d7b4b-1599-45ac-a47a-8670cdf835b3 tempest-SnapshotsActionsTest-914703108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.313s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b24d7b4b-1599-45ac-a47a-8670cdf835b3 tempest-SnapshotsActionsTest-914703108 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:06:07 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-b24d7b4b-1599-45ac-a47a-8670cdf835b3 tempest-SnapshotsActionsTest-914703108 None] Deleted volume successfully. Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f8377a-c186-4379-a2c4-145159ca9bf1]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_9ihk152adevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:07 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Volume volume-d9293273-1223-45b8-bc5b-a5348c4527db (d9293273-1223-45b8-bc5b-a5348c4527db): created successfully Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a5a3e8b-5f24-437a-92b0-0740fec18e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Flow 'volume_create_manager' (fa0c8230-50ca-4cfe-889b-8cfec0bf566a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:06:07 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-0dc8d97f-8140-498e-90cc-ace6a73bf4ea tempest-AttachVolumeNegativeTest-203049611 None] Created volume successfully. Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b24d7b4b-1599-45ac-a47a-8670cdf835b3 tempest-SnapshotsActionsTest-914703108 None] Lock "cinder-770da1e4-2749-487a-aa43-ac38740b0247-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:06:07 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_9ihk152adevstack@QuobyteHD Sep 05 05:06:07 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:07 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9578942-9108-41b9-8746-09fc3d4a132f 1073741824" returned: 0 in 0.432s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:07 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9578942-9108-41b9-8746-09fc3d4a132f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_9ihk152adevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:07 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9578942-9108-41b9-8746-09fc3d4a132f Sep 05 05:06:07 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:08 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9578942-9108-41b9-8746-09fc3d4a132f" returned: 0 in 0.256s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:06:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.251s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-301903845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5913549-be6d-4464-b9cc-8e4ff6f7d17e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5e1c7cc5684fb0aa20ef92be4afdb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:06:05Z,use_quota=True,user_id='d71c0e8e09ee4d00a6a9e78503f79464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:06:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Creating volume e5913549-be6d-4464-b9cc-8e4ff6f7d17e {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:06:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:06:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:06:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:06:08 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:06:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c96f776-3624-42f6-9c88-128a84f4a4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9578942-9108-41b9-8746-09fc3d4a132f', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:08 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e 1073741824 Sep 05 05:06:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f10016-b07a-42b5-98e3-951f16c2b7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:08 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:08 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Volume volume-d9578942-9108-41b9-8746-09fc3d4a132f (d9578942-9108-41b9-8746-09fc3d4a132f): created successfully Sep 05 05:06:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f10016-b07a-42b5-98e3-951f16c2b7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Flow 'volume_create_manager' (3cecc31f-203d-47a2-bfb4-8568c2dd10a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:06:08 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-759e6edf-d263-44fb-8d14-12edc7d84325 tempest-AttachVolumeTestJSON-200281865 None] Created volume successfully. Sep 05 05:06:08 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e 1073741824" returned: 0 in 0.562s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:08 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e Sep 05 05:06:08 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:09 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e" returned: 0 in 0.418s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:06:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:09 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Attempting download of a60f4e58-9471-4dd7-bff3-114bdbd77a8d ((None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}])) to volume e5913549-be6d-4464-b9cc-8e4ff6f7d17e. {{(pid=89331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 05:06:09 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3a7467-9280-4ea3-927a-610df1bf077e]: (4, 'raw') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:06:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_s9y_v11i {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:09 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_s9y_v11i Sep 05 05:06:09 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-6d3717c2-06b4-4e11-801f-282335698f8a req-c7cfa838-991d-42bd-a5bd-0766af35bf37 tempest-AttachVolumeTestJSON-200281865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-6d3717c2-06b4-4e11-801f-282335698f8a req-c7cfa838-991d-42bd-a5bd-0766af35bf37 tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-6d3717c2-06b4-4e11-801f-282335698f8a req-c7cfa838-991d-42bd-a5bd-0766af35bf37 tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-6d3717c2-06b4-4e11-801f-282335698f8a req-c7cfa838-991d-42bd-a5bd-0766af35bf37 tempest-AttachVolumeTestJSON-200281865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136', 'name': 'volume-d9578942-9108-41b9-8746-09fc3d4a132f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51a4c898-4f10-417a-a532-f07cfa122e45', 'enforce_multipath': True} {{(pid=89331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 05:06:09 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_s9y_v11i" returned: 0 in 0.421s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_s9y_v11i {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:09 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-6d3717c2-06b4-4e11-801f-282335698f8a req-c7cfa838-991d-42bd-a5bd-0766af35bf37 tempest-AttachVolumeTestJSON-200281865 None] attachment_update completed successfully. Sep 05 05:06:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-01c03854-537e-42f0-9ae5-b408a95643e3 req-7c4113b9-471f-44b5-bce3-6f68681b52fd tempest-AttachVolumeNegativeTest-203049611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:09 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_s9y_v11i Sep 05 05:06:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-01c03854-537e-42f0-9ae5-b408a95643e3 req-7c4113b9-471f-44b5-bce3-6f68681b52fd tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:09 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-01c03854-537e-42f0-9ae5-b408a95643e3 req-7c4113b9-471f-44b5-bce3-6f68681b52fd tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-01c03854-537e-42f0-9ae5-b408a95643e3 req-7c4113b9-471f-44b5-bce3-6f68681b52fd tempest-AttachVolumeNegativeTest-203049611 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136', 'name': 'volume-d9293273-1223-45b8-bc5b-a5348c4527db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2633f1b-8106-4206-8511-965ddb3b5e2d', 'enforce_multipath': True} {{(pid=89331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 05:06:09 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-01c03854-537e-42f0-9ae5-b408a95643e3 req-7c4113b9-471f-44b5-bce3-6f68681b52fd tempest-AttachVolumeNegativeTest-203049611 None] attachment_update completed successfully. Sep 05 05:06:10 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_s9y_v11i" returned: 1 in 0.392s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_s9y_v11i' failed. Not Retrying. {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 05:06:10 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac07b399-b996-41c7-8314-e4a033cde84f]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:06:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_9ihk152adevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:10 devstack sudo[95436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_9ihk152adevstack@QuobyteHD Sep 05 05:06:10 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:10 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_9ihk152adevstack@QuobyteHD" returned: 0 in 0.540s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:10 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] a60f4e58-9471-4dd7-bff3-114bdbd77a8d was qcow2, converting to qcow2 {{(pid=89331) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 05:06:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_9ihk152adevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:10 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_9ihk152adevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e Sep 05 05:06:10 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Flow 'volume_create_manager' (5e2ee6ee-c375-4825-afeb-e688f8cd5d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f568a463-9245-41bb-b023-ed817e497a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f568a463-9245-41bb-b023-ed817e497a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1356930625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62050ed0-9494-4b19-961f-ffe0ff92c846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a69f0622a0874d20a86028e75af9fb59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:06:12Z,use_quota=True,user_id='55532b8573ab45f98b984cd26de1bc49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a668eb-d3f9-4dc3-be80-7063b2e7716c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a668eb-d3f9-4dc3-be80-7063b2e7716c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a98b19f-05a9-490d-b055-72844a1df791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a98b19f-05a9-490d-b055-72844a1df791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62050ed0-9494-4b19-961f-ffe0ff92c846', 'volume_name': 'volume-62050ed0-9494-4b19-961f-ffe0ff92c846', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1494dac-1146-49a2-a851-9c20ec126b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1494dac-1146-49a2-a851-9c20ec126b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0699dda-79a7-488b-9ed2-dbbb16e3f237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:12 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Volume 62050ed0-9494-4b19-961f-ffe0ff92c846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62050ed0-9494-4b19-961f-ffe0ff92c846', 'volume_size': 1} Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1356930625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62050ed0-9494-4b19-961f-ffe0ff92c846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a69f0622a0874d20a86028e75af9fb59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:06:12Z,use_quota=True,user_id='55532b8573ab45f98b984cd26de1bc49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Creating volume 62050ed0-9494-4b19-961f-ffe0ff92c846 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:06:12 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62050ed0-9494-4b19-961f-ffe0ff92c846 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:12 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62050ed0-9494-4b19-961f-ffe0ff92c846 1073741824 Sep 05 05:06:12 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:12 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-07b8457a-25b4-4c71-8c13-f148e9a55b6c req-b505e5ac-f3f8-4f58-8392-19d195cb715e tempest-AttachVolumeNegativeTest-203049611 None] Terminate volume connection completed successfully. Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-07b8457a-25b4-4c71-8c13-f148e9a55b6c req-b505e5ac-f3f8-4f58-8392-19d195cb715e tempest-AttachVolumeNegativeTest-203049611 None] Deleting attachment c2633f1b-8106-4206-8511-965ddb3b5e2d. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:06:12 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62050ed0-9494-4b19-961f-ffe0ff92c846 1073741824" returned: 0 in 0.555s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62050ed0-9494-4b19-961f-ffe0ff92c846 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:12 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_9ihk152adevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e" returned: 0 in 2.313s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_9ihk152adevstack@QuobyteHD, size 112.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:06:12 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Converted 112.00 MB image at 48.38 MB/s Sep 05 05:06:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:12 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62050ed0-9494-4b19-961f-ffe0ff92c846 Sep 05 05:06:12 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:12 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e 1G Sep 05 05:06:12 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:13 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62050ed0-9494-4b19-961f-ffe0ff92c846" returned: 0 in 0.353s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:13 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:06:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0699dda-79a7-488b-9ed2-dbbb16e3f237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62050ed0-9494-4b19-961f-ffe0ff92c846', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdaf50eb-d745-430b-a25c-310872760fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:13 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Volume volume-62050ed0-9494-4b19-961f-ffe0ff92c846 (62050ed0-9494-4b19-961f-ffe0ff92c846): created successfully Sep 05 05:06:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdaf50eb-d745-430b-a25c-310872760fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Flow 'volume_create_manager' (5e2ee6ee-c375-4825-afeb-e688f8cd5d5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:06:13 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-a08ecf9e-c115-4286-a1fb-0d9c59024a70 tempest-AttachVolumeTestJSON-200281865 None] Created volume successfully. Sep 05 05:06:13 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e 1G" returned: 0 in 0.446s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:13 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Downloaded image a60f4e58-9471-4dd7-bff3-114bdbd77a8d ((None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}])) to volume e5913549-be6d-4464-b9cc-8e4ff6f7d17e successfully. {{(pid=89331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 05:06:13 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Temporary image a60f4e58-9471-4dd7-bff3-114bdbd77a8d for user d71c0e8e09ee4d00a6a9e78503f79464 is deleted. {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 05:06:13 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Marking volume e5913549-be6d-4464-b9cc-8e4ff6f7d17e as bootable. {{(pid=89331) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 05:06:13 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Copying metadata from image a60f4e58-9471-4dd7-bff3-114bdbd77a8d to e5913549-be6d-4464-b9cc-8e4ff6f7d17e. {{(pid=89331) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 05:06:13 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Creating volume glance metadata for volume e5913549-be6d-4464-b9cc-8e4ff6f7d17e backed by image a60f4e58-9471-4dd7-bff3-114bdbd77a8d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89331) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 05:06:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (641c1ede-0209-4875-b57e-fcc83f0053bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e', 'volume_size': 1, 'image_id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '06b067117d184688bd2e16e21ff323f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'created_at': datetime.datetime(2026, 9, 5, 2, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 55, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1db3d12-d910-4984-be51-39f1f5623d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:13 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Volume volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e (e5913549-be6d-4464-b9cc-8e4ff6f7d17e): created successfully Sep 05 05:06:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1db3d12-d910-4984-be51-39f1f5623d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Flow 'volume_create_manager' (8fdb0295-8735-46f7-bfc3-3128dfd84625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:06:13 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-e2132dba-45d8-45bd-9de3-c2d186950f2b tempest-ServerActionsTestOtherA-74061543 None] Created volume successfully. Sep 05 05:06:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-949f5046-e47e-4e4e-9a4f-d4a864e57838 req-d6587c8c-3974-49ad-a3df-1a723b9bb865 tempest-AttachVolumeTestJSON-200281865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-949f5046-e47e-4e4e-9a4f-d4a864e57838 req-d6587c8c-3974-49ad-a3df-1a723b9bb865 tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-949f5046-e47e-4e4e-9a4f-d4a864e57838 req-d6587c8c-3974-49ad-a3df-1a723b9bb865 tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:15 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-949f5046-e47e-4e4e-9a4f-d4a864e57838 req-d6587c8c-3974-49ad-a3df-1a723b9bb865 tempest-AttachVolumeTestJSON-200281865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136', 'name': 'volume-62050ed0-9494-4b19-961f-ffe0ff92c846', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48fd0e16-ea1f-481f-9f14-48194deeebf3', 'enforce_multipath': True} {{(pid=89331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 05:06:15 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-949f5046-e47e-4e4e-9a4f-d4a864e57838 req-d6587c8c-3974-49ad-a3df-1a723b9bb865 tempest-AttachVolumeTestJSON-200281865 None] attachment_update completed successfully. Sep 05 05:06:18 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-bac1a0bc-32e2-4a22-973e-ce80eac7ace0 req-1519319c-7dcf-4737-a177-6c97e06bd328 tempest-AttachVolumeTestJSON-200281865 None] Terminate volume connection completed successfully. Sep 05 05:06:18 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-bac1a0bc-32e2-4a22-973e-ce80eac7ace0 req-1519319c-7dcf-4737-a177-6c97e06bd328 tempest-AttachVolumeTestJSON-200281865 None] Deleting attachment 51a4c898-4f10-417a-a532-f07cfa122e45. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:06:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-68b570f6-5bdd-45ef-8d96-9dfcc262a467 req-786206a6-fbc2-447a-91c7-60a165f30ac1 tempest-ServerActionsTestOtherA-74061543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-68b570f6-5bdd-45ef-8d96-9dfcc262a467 req-786206a6-fbc2-447a-91c7-60a165f30ac1 tempest-ServerActionsTestOtherA-74061543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-68b570f6-5bdd-45ef-8d96-9dfcc262a467 req-786206a6-fbc2-447a-91c7-60a165f30ac1 tempest-ServerActionsTestOtherA-74061543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:18 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-68b570f6-5bdd-45ef-8d96-9dfcc262a467 req-786206a6-fbc2-447a-91c7-60a165f30ac1 tempest-ServerActionsTestOtherA-74061543 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136', 'name': 'volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '55f50dd1-b4cb-4f92-86f4-7146bd9ad1f7', 'enforce_multipath': True} {{(pid=89331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 05:06:19 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-68b570f6-5bdd-45ef-8d96-9dfcc262a467 req-786206a6-fbc2-447a-91c7-60a165f30ac1 tempest-ServerActionsTestOtherA-74061543 None] attachment_update completed successfully. Sep 05 05:06:20 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-080f2b56-c315-4dc0-9072-515a64bd3b4f req-fe5ff20e-16ec-4f9a-b56d-0e83622b6ded tempest-AttachVolumeTestJSON-200281865 None] Terminate volume connection completed successfully. Sep 05 05:06:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-080f2b56-c315-4dc0-9072-515a64bd3b4f req-fe5ff20e-16ec-4f9a-b56d-0e83622b6ded tempest-AttachVolumeTestJSON-200281865 None] Deleting attachment 48fd0e16-ea1f-481f-9f14-48194deeebf3. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-86872a8d-6798-4157-a693-5a78bbf86158 tempest-AttachVolumeTestJSON-200281865 None] Acquiring lock "cinder-62050ed0-9494-4b19-961f-ffe0ff92c846-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-86872a8d-6798-4157-a693-5a78bbf86158 tempest-AttachVolumeTestJSON-200281865 None] Lock "cinder-62050ed0-9494-4b19-961f-ffe0ff92c846-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-86872a8d-6798-4157-a693-5a78bbf86158 tempest-AttachVolumeTestJSON-200281865 None] Acquiring lock "cinder-quobyte-62050ed0-9494-4b19-961f-ffe0ff92c846" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-86872a8d-6798-4157-a693-5a78bbf86158 tempest-AttachVolumeTestJSON-200281865 None] Lock "cinder-quobyte-62050ed0-9494-4b19-961f-ffe0ff92c846" acquired by "delete_volume" :: waited 0.031s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc576ea-f724-448b-8e0c-7fb59ebcd694]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-86872a8d-6798-4157-a693-5a78bbf86158 tempest-AttachVolumeTestJSON-200281865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62050ed0-9494-4b19-961f-ffe0ff92c846 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:06:27 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62050ed0-9494-4b19-961f-ffe0ff92c846 Sep 05 05:06:27 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Flow 'volume_create_manager' (ee0a7400-2a7b-4e3f-8c90-64743d067013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f88c68-48a8-4de4-a1ee-0fbc2cba0e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f88c68-48a8-4de4-a1ee-0fbc2cba0e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-622320164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6596e8aa-8673-4e1b-8fe4-934e7eddf305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2353bb48e02346f59a7a1999e746669f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:06:28Z,use_quota=True,user_id='ae16b20231bc4cfb8b72718133b5288e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b47eae-0c77-4dbf-9e5c-e441f140d1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b47eae-0c77-4dbf-9e5c-e441f140d1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d27eca83-1737-4850-9200-14e749b8e8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d27eca83-1737-4850-9200-14e749b8e8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6596e8aa-8673-4e1b-8fe4-934e7eddf305', 'volume_name': 'volume-6596e8aa-8673-4e1b-8fe4-934e7eddf305', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e2f5ff-57ab-40d0-8a4f-878c330f0838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e2f5ff-57ab-40d0-8a4f-878c330f0838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ebdfad5-31e8-4bc8-afbe-665ecd87208e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:27 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Volume 6596e8aa-8673-4e1b-8fe4-934e7eddf305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6596e8aa-8673-4e1b-8fe4-934e7eddf305', 'volume_size': 1} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-622320164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6596e8aa-8673-4e1b-8fe4-934e7eddf305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2353bb48e02346f59a7a1999e746669f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:06:28Z,use_quota=True,user_id='ae16b20231bc4cfb8b72718133b5288e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Creating volume 6596e8aa-8673-4e1b-8fe4-934e7eddf305 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:06:27 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:06:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6596e8aa-8673-4e1b-8fe4-934e7eddf305 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:27 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6596e8aa-8673-4e1b-8fe4-934e7eddf305 1073741824 Sep 05 05:06:27 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:28 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-86872a8d-6798-4157-a693-5a78bbf86158 tempest-AttachVolumeTestJSON-200281865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62050ed0-9494-4b19-961f-ffe0ff92c846" returned: 0 in 0.534s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-86872a8d-6798-4157-a693-5a78bbf86158 tempest-AttachVolumeTestJSON-200281865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62050ed0-9494-4b19-961f-ffe0ff92c846 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:28 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62050ed0-9494-4b19-961f-ffe0ff92c846 Sep 05 05:06:28 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:28 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-86872a8d-6798-4157-a693-5a78bbf86158 tempest-AttachVolumeTestJSON-200281865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-62050ed0-9494-4b19-961f-ffe0ff92c846" returned: 0 in 0.427s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-86872a8d-6798-4157-a693-5a78bbf86158 tempest-AttachVolumeTestJSON-200281865 None] Lock "cinder-quobyte-62050ed0-9494-4b19-961f-ffe0ff92c846" released by "delete_volume" :: held 1.046s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:06:28 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6596e8aa-8673-4e1b-8fe4-934e7eddf305 1073741824" returned: 0 in 0.796s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:28 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-86872a8d-6798-4157-a693-5a78bbf86158 tempest-AttachVolumeTestJSON-200281865 None] Created reservations ['5ca31395-ffc6-4e78-9627-8f103e4fb64d', 'c2bf7969-7d25-42d9-bf17-fee1af09defd', '40dc8098-854d-4b11-87ae-caab8c88d308', '74a75131-f3f6-44a1-94b4-f12e21af03c6'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:06:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6596e8aa-8673-4e1b-8fe4-934e7eddf305 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:28 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6596e8aa-8673-4e1b-8fe4-934e7eddf305 Sep 05 05:06:28 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-86872a8d-6798-4157-a693-5a78bbf86158 tempest-AttachVolumeTestJSON-200281865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-86872a8d-6798-4157-a693-5a78bbf86158 tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-86872a8d-6798-4157-a693-5a78bbf86158 tempest-AttachVolumeTestJSON-200281865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:06:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-86872a8d-6798-4157-a693-5a78bbf86158 tempest-AttachVolumeTestJSON-200281865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:06:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-86872a8d-6798-4157-a693-5a78bbf86158 tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-86872a8d-6798-4157-a693-5a78bbf86158 tempest-AttachVolumeTestJSON-200281865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:29 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:06:29 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:29 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6596e8aa-8673-4e1b-8fe4-934e7eddf305" returned: 0 in 0.465s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:29 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:06:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ebdfad5-31e8-4bc8-afbe-665ecd87208e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6596e8aa-8673-4e1b-8fe4-934e7eddf305', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df5bf7e-39de-4ea1-b298-b8b738025dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:29 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Volume volume-6596e8aa-8673-4e1b-8fe4-934e7eddf305 (6596e8aa-8673-4e1b-8fe4-934e7eddf305): created successfully Sep 05 05:06:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df5bf7e-39de-4ea1-b298-b8b738025dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:29 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Flow 'volume_create_manager' (ee0a7400-2a7b-4e3f-8c90-64743d067013) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:06:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-86872a8d-6798-4157-a693-5a78bbf86158 tempest-AttachVolumeTestJSON-200281865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.493s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:29 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-86872a8d-6798-4157-a693-5a78bbf86158 tempest-AttachVolumeTestJSON-200281865 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:06:29 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-86872a8d-6798-4157-a693-5a78bbf86158 tempest-AttachVolumeTestJSON-200281865 None] Deleted volume successfully. Sep 05 05:06:29 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-999cfc42-2d53-4d7d-97c7-f312f0efbd50 tempest-VolumeQuotasAdminTestJSON-381916234 None] Created volume successfully. Sep 05 05:06:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-86872a8d-6798-4157-a693-5a78bbf86158 tempest-AttachVolumeTestJSON-200281865 None] Lock "cinder-62050ed0-9494-4b19-961f-ffe0ff92c846-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:06:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-af8cb7d1-cf89-427d-9c3d-d9290719a8db tempest-AttachVolumeTestJSON-200281865 None] Acquiring lock "cinder-d9578942-9108-41b9-8746-09fc3d4a132f-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:06:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-af8cb7d1-cf89-427d-9c3d-d9290719a8db tempest-AttachVolumeTestJSON-200281865 None] Lock "cinder-d9578942-9108-41b9-8746-09fc3d4a132f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:06:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-af8cb7d1-cf89-427d-9c3d-d9290719a8db tempest-AttachVolumeTestJSON-200281865 None] Acquiring lock "cinder-quobyte-d9578942-9108-41b9-8746-09fc3d4a132f" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:06:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-af8cb7d1-cf89-427d-9c3d-d9290719a8db tempest-AttachVolumeTestJSON-200281865 None] Lock "cinder-quobyte-d9578942-9108-41b9-8746-09fc3d4a132f" acquired by "delete_volume" :: waited 0.024s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:06:29 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[001c50a6-3d92-433d-86f6-32f6b0d44757]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:06:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-af8cb7d1-cf89-427d-9c3d-d9290719a8db tempest-AttachVolumeTestJSON-200281865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9578942-9108-41b9-8746-09fc3d4a132f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c5431f8e-be90-4470-a384-5307bbedc611 tempest-VolumeQuotasAdminTestJSON-381916234 None] Acquiring lock "cinder-6596e8aa-8673-4e1b-8fe4-934e7eddf305-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:06:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c5431f8e-be90-4470-a384-5307bbedc611 tempest-VolumeQuotasAdminTestJSON-381916234 None] Lock "cinder-6596e8aa-8673-4e1b-8fe4-934e7eddf305-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:06:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c5431f8e-be90-4470-a384-5307bbedc611 tempest-VolumeQuotasAdminTestJSON-381916234 None] Acquiring lock "cinder-quobyte-6596e8aa-8673-4e1b-8fe4-934e7eddf305" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:06:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c5431f8e-be90-4470-a384-5307bbedc611 tempest-VolumeQuotasAdminTestJSON-381916234 None] Lock "cinder-quobyte-6596e8aa-8673-4e1b-8fe4-934e7eddf305" acquired by "delete_volume" :: waited 0.023s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:06:30 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e62751e-8dd5-4e73-ba33-f3ccd7112bb7]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:06:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c5431f8e-be90-4470-a384-5307bbedc611 tempest-VolumeQuotasAdminTestJSON-381916234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6596e8aa-8673-4e1b-8fe4-934e7eddf305 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:30 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9578942-9108-41b9-8746-09fc3d4a132f Sep 05 05:06:30 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:30 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6596e8aa-8673-4e1b-8fe4-934e7eddf305 Sep 05 05:06:30 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:30 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c5431f8e-be90-4470-a384-5307bbedc611 tempest-VolumeQuotasAdminTestJSON-381916234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6596e8aa-8673-4e1b-8fe4-934e7eddf305" returned: 0 in 0.662s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c5431f8e-be90-4470-a384-5307bbedc611 tempest-VolumeQuotasAdminTestJSON-381916234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6596e8aa-8673-4e1b-8fe4-934e7eddf305 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:31 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6596e8aa-8673-4e1b-8fe4-934e7eddf305 Sep 05 05:06:31 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:31 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-af8cb7d1-cf89-427d-9c3d-d9290719a8db tempest-AttachVolumeTestJSON-200281865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9578942-9108-41b9-8746-09fc3d4a132f" returned: 0 in 1.088s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-af8cb7d1-cf89-427d-9c3d-d9290719a8db tempest-AttachVolumeTestJSON-200281865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9578942-9108-41b9-8746-09fc3d4a132f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:31 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9578942-9108-41b9-8746-09fc3d4a132f Sep 05 05:06:31 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:31 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c5431f8e-be90-4470-a384-5307bbedc611 tempest-VolumeQuotasAdminTestJSON-381916234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6596e8aa-8673-4e1b-8fe4-934e7eddf305" returned: 0 in 0.597s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c5431f8e-be90-4470-a384-5307bbedc611 tempest-VolumeQuotasAdminTestJSON-381916234 None] Lock "cinder-quobyte-6596e8aa-8673-4e1b-8fe4-934e7eddf305" released by "delete_volume" :: held 1.319s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:06:31 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-c5431f8e-be90-4470-a384-5307bbedc611 tempest-VolumeQuotasAdminTestJSON-381916234 None] Created reservations ['5f22fd40-7ac4-4a6f-9b12-e6bae398817b', '27cd57d9-2b04-4b2c-830b-7da97b1d5b65', '96b6b8b0-f9ce-469b-b8cd-2e5c542df032', '5f9acc81-5208-4dbb-ab1e-e727290954de'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:06:31 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-af8cb7d1-cf89-427d-9c3d-d9290719a8db tempest-AttachVolumeTestJSON-200281865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9578942-9108-41b9-8746-09fc3d4a132f" returned: 0 in 0.605s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-af8cb7d1-cf89-427d-9c3d-d9290719a8db tempest-AttachVolumeTestJSON-200281865 None] Lock "cinder-quobyte-d9578942-9108-41b9-8746-09fc3d4a132f" released by "delete_volume" :: held 1.775s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:06:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c5431f8e-be90-4470-a384-5307bbedc611 tempest-VolumeQuotasAdminTestJSON-381916234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c5431f8e-be90-4470-a384-5307bbedc611 tempest-VolumeQuotasAdminTestJSON-381916234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c5431f8e-be90-4470-a384-5307bbedc611 tempest-VolumeQuotasAdminTestJSON-381916234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:06:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c5431f8e-be90-4470-a384-5307bbedc611 tempest-VolumeQuotasAdminTestJSON-381916234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:06:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c5431f8e-be90-4470-a384-5307bbedc611 tempest-VolumeQuotasAdminTestJSON-381916234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c5431f8e-be90-4470-a384-5307bbedc611 tempest-VolumeQuotasAdminTestJSON-381916234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:31 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:06:31 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:31 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-af8cb7d1-cf89-427d-9c3d-d9290719a8db tempest-AttachVolumeTestJSON-200281865 None] Created reservations ['5164f980-9a27-4f12-8190-68097cec5791', '1d03048c-b567-4e91-a26d-ab3561a9c399', '1f73d4f2-17d0-46ed-824c-338e2673fee5', '7ad70b83-28b5-46c1-92a6-d96178e12436'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:06:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-af8cb7d1-cf89-427d-9c3d-d9290719a8db tempest-AttachVolumeTestJSON-200281865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-af8cb7d1-cf89-427d-9c3d-d9290719a8db tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:32 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-af8cb7d1-cf89-427d-9c3d-d9290719a8db tempest-AttachVolumeTestJSON-200281865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:06:32 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-af8cb7d1-cf89-427d-9c3d-d9290719a8db tempest-AttachVolumeTestJSON-200281865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:06:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-af8cb7d1-cf89-427d-9c3d-d9290719a8db tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-af8cb7d1-cf89-427d-9c3d-d9290719a8db tempest-AttachVolumeTestJSON-200281865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:32 devstack sudo[96415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:06:32 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:32 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c5431f8e-be90-4470-a384-5307bbedc611 tempest-VolumeQuotasAdminTestJSON-381916234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.399s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:32 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-c5431f8e-be90-4470-a384-5307bbedc611 tempest-VolumeQuotasAdminTestJSON-381916234 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:06:32 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-c5431f8e-be90-4470-a384-5307bbedc611 tempest-VolumeQuotasAdminTestJSON-381916234 None] Deleted volume successfully. Sep 05 05:06:32 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c5431f8e-be90-4470-a384-5307bbedc611 tempest-VolumeQuotasAdminTestJSON-381916234 None] Lock "cinder-6596e8aa-8673-4e1b-8fe4-934e7eddf305-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:06:32 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-eaf26833-ff0a-40bc-a528-c6628bf0151b tempest-AttachVolumeTestJSON-200281865 None] Acquiring lock "cinder-499c93e9-5791-4f34-8636-e0db23adfa51-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:06:32 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-eaf26833-ff0a-40bc-a528-c6628bf0151b tempest-AttachVolumeTestJSON-200281865 None] Lock "cinder-499c93e9-5791-4f34-8636-e0db23adfa51-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:06:32 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-af8cb7d1-cf89-427d-9c3d-d9290719a8db tempest-AttachVolumeTestJSON-200281865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.874s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:32 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-af8cb7d1-cf89-427d-9c3d-d9290719a8db tempest-AttachVolumeTestJSON-200281865 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:06:32 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-af8cb7d1-cf89-427d-9c3d-d9290719a8db tempest-AttachVolumeTestJSON-200281865 None] Deleted volume successfully. Sep 05 05:06:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-af8cb7d1-cf89-427d-9c3d-d9290719a8db tempest-AttachVolumeTestJSON-200281865 None] Lock "cinder-d9578942-9108-41b9-8746-09fc3d4a132f-delete_volume" released by "delete_volume" :: held 3.267s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:06:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-eaf26833-ff0a-40bc-a528-c6628bf0151b tempest-AttachVolumeTestJSON-200281865 None] Acquiring lock "cinder-quobyte-499c93e9-5791-4f34-8636-e0db23adfa51" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:06:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-eaf26833-ff0a-40bc-a528-c6628bf0151b tempest-AttachVolumeTestJSON-200281865 None] Lock "cinder-quobyte-499c93e9-5791-4f34-8636-e0db23adfa51" acquired by "delete_volume" :: waited 0.047s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:06:33 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edf8e5f-8b58-4284-8aba-0747a83c37bd]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:06:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-eaf26833-ff0a-40bc-a528-c6628bf0151b tempest-AttachVolumeTestJSON-200281865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-499c93e9-5791-4f34-8636-e0db23adfa51 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:33 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-499c93e9-5791-4f34-8636-e0db23adfa51 Sep 05 05:06:33 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:34 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-eaf26833-ff0a-40bc-a528-c6628bf0151b tempest-AttachVolumeTestJSON-200281865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-499c93e9-5791-4f34-8636-e0db23adfa51" returned: 0 in 0.949s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-eaf26833-ff0a-40bc-a528-c6628bf0151b tempest-AttachVolumeTestJSON-200281865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-499c93e9-5791-4f34-8636-e0db23adfa51 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:34 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-499c93e9-5791-4f34-8636-e0db23adfa51 Sep 05 05:06:34 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:34 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=119,cinder:INSERT=30,cinder:UPDATE=89,cinder:DELETE=7 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:06:34 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:UPDATE=95,cinder:SELECT=98,cinder:INSERT=26,cinder:DELETE=8 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:06:34 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:06:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Flow 'volume_create_manager' (1dbd3f74-b49a-4c4a-bee1-6781b6bf8997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:06:34 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f05b41-5828-42e9-9552-c4313a8da18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-eaf26833-ff0a-40bc-a528-c6628bf0151b tempest-AttachVolumeTestJSON-200281865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-499c93e9-5791-4f34-8636-e0db23adfa51" returned: 0 in 0.531s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f05b41-5828-42e9-9552-c4313a8da18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1712788892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=898554ad-4990-4ae5-9254-a40223fde077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2353bb48e02346f59a7a1999e746669f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:06:34Z,use_quota=True,user_id='ae16b20231bc4cfb8b72718133b5288e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f118eed4-8f07-476b-adb4-f6694969f394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f118eed4-8f07-476b-adb4-f6694969f394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ffd9067-3a2c-4af6-9f17-c037e531f564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ffd9067-3a2c-4af6-9f17-c037e531f564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '898554ad-4990-4ae5-9254-a40223fde077', 'volume_name': 'volume-898554ad-4990-4ae5-9254-a40223fde077', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdab603e-04e3-4b8b-bbf9-368e31b50b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdab603e-04e3-4b8b-bbf9-368e31b50b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb610762-5cc9-40b2-8cfb-560f1b941728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:35 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Volume 898554ad-4990-4ae5-9254-a40223fde077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-898554ad-4990-4ae5-9254-a40223fde077', 'volume_size': 1} Sep 05 05:06:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1712788892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=898554ad-4990-4ae5-9254-a40223fde077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2353bb48e02346f59a7a1999e746669f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:06:34Z,use_quota=True,user_id='ae16b20231bc4cfb8b72718133b5288e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:06:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Creating volume 898554ad-4990-4ae5-9254-a40223fde077 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:06:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:06:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:06:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:06:35 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:06:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-898554ad-4990-4ae5-9254-a40223fde077 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:35 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-eaf26833-ff0a-40bc-a528-c6628bf0151b tempest-AttachVolumeTestJSON-200281865 None] Lock "cinder-quobyte-499c93e9-5791-4f34-8636-e0db23adfa51" released by "delete_volume" :: held 2.027s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:06:35 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-898554ad-4990-4ae5-9254-a40223fde077 1073741824 Sep 05 05:06:35 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:35 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-eaf26833-ff0a-40bc-a528-c6628bf0151b tempest-AttachVolumeTestJSON-200281865 None] Created reservations ['59e50454-9460-4c0c-9a7a-5648cb925ba7', '797e6ae0-23ae-459f-b1d6-0b9e6baf66bc', 'b0db84ae-3035-4e23-9448-aad75293ae5e', 'f235b54d-31fd-4242-9641-04838fbd8758'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:06:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-eaf26833-ff0a-40bc-a528-c6628bf0151b tempest-AttachVolumeTestJSON-200281865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-eaf26833-ff0a-40bc-a528-c6628bf0151b tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-eaf26833-ff0a-40bc-a528-c6628bf0151b tempest-AttachVolumeTestJSON-200281865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:06:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-eaf26833-ff0a-40bc-a528-c6628bf0151b tempest-AttachVolumeTestJSON-200281865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:06:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-eaf26833-ff0a-40bc-a528-c6628bf0151b tempest-AttachVolumeTestJSON-200281865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-eaf26833-ff0a-40bc-a528-c6628bf0151b tempest-AttachVolumeTestJSON-200281865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:35 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:06:35 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:36 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:36 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-898554ad-4990-4ae5-9254-a40223fde077 1073741824" returned: 0 in 1.378s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-eaf26833-ff0a-40bc-a528-c6628bf0151b tempest-AttachVolumeTestJSON-200281865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.759s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:36 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-eaf26833-ff0a-40bc-a528-c6628bf0151b tempest-AttachVolumeTestJSON-200281865 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:06:36 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-eaf26833-ff0a-40bc-a528-c6628bf0151b tempest-AttachVolumeTestJSON-200281865 None] Deleted volume successfully. Sep 05 05:06:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-eaf26833-ff0a-40bc-a528-c6628bf0151b tempest-AttachVolumeTestJSON-200281865 None] Lock "cinder-499c93e9-5791-4f34-8636-e0db23adfa51-delete_volume" released by "delete_volume" :: held 3.842s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:06:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-898554ad-4990-4ae5-9254-a40223fde077 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:36 devstack sudo[96505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-898554ad-4990-4ae5-9254-a40223fde077 Sep 05 05:06:36 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:37 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-898554ad-4990-4ae5-9254-a40223fde077" returned: 0 in 0.644s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:37 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] <== create_volume: return (2311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:06:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.337s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:37 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb610762-5cc9-40b2-8cfb-560f1b941728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-898554ad-4990-4ae5-9254-a40223fde077', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:37 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee82286-d06e-4833-a8cb-86d27fb49edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:37 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Volume volume-898554ad-4990-4ae5-9254-a40223fde077 (898554ad-4990-4ae5-9254-a40223fde077): created successfully Sep 05 05:06:37 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee82286-d06e-4833-a8cb-86d27fb49edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:37 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Flow 'volume_create_manager' (1dbd3f74-b49a-4c4a-bee1-6781b6bf8997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:06:37 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-5159e847-6854-4334-99e3-d0b8862b7cb2 tempest-VolumeQuotasAdminTestJSON-381916234 None] Created volume successfully. Sep 05 05:06:39 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-fdb5d4dc-18b1-47ba-9f07-d3981b021fc7 tempest-VolumeQuotasAdminTestJSON-749311319 None] Transfer volume completed successfully. Sep 05 05:06:40 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-087d61c8-0899-4830-9cc1-2e7d2cc67b84 tempest-VolumeQuotasAdminTestJSON-1828718627 None] Acquiring lock "cinder-898554ad-4990-4ae5-9254-a40223fde077-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:06:40 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-087d61c8-0899-4830-9cc1-2e7d2cc67b84 tempest-VolumeQuotasAdminTestJSON-1828718627 None] Lock "cinder-898554ad-4990-4ae5-9254-a40223fde077-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:06:40 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-087d61c8-0899-4830-9cc1-2e7d2cc67b84 tempest-VolumeQuotasAdminTestJSON-1828718627 None] Acquiring lock "cinder-quobyte-898554ad-4990-4ae5-9254-a40223fde077" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:06:40 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-087d61c8-0899-4830-9cc1-2e7d2cc67b84 tempest-VolumeQuotasAdminTestJSON-1828718627 None] Lock "cinder-quobyte-898554ad-4990-4ae5-9254-a40223fde077" acquired by "delete_volume" :: waited 0.026s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:06:40 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0db6fd6-fc37-4bd1-a3b1-c820d75b175f]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:06:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-087d61c8-0899-4830-9cc1-2e7d2cc67b84 tempest-VolumeQuotasAdminTestJSON-1828718627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-898554ad-4990-4ae5-9254-a40223fde077 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:41 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-898554ad-4990-4ae5-9254-a40223fde077 Sep 05 05:06:41 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:41 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-087d61c8-0899-4830-9cc1-2e7d2cc67b84 tempest-VolumeQuotasAdminTestJSON-1828718627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-898554ad-4990-4ae5-9254-a40223fde077" returned: 0 in 0.677s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-087d61c8-0899-4830-9cc1-2e7d2cc67b84 tempest-VolumeQuotasAdminTestJSON-1828718627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-898554ad-4990-4ae5-9254-a40223fde077 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:41 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-898554ad-4990-4ae5-9254-a40223fde077 Sep 05 05:06:41 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:42 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-087d61c8-0899-4830-9cc1-2e7d2cc67b84 tempest-VolumeQuotasAdminTestJSON-1828718627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-898554ad-4990-4ae5-9254-a40223fde077" returned: 0 in 0.582s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:42 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-087d61c8-0899-4830-9cc1-2e7d2cc67b84 tempest-VolumeQuotasAdminTestJSON-1828718627 None] Lock "cinder-quobyte-898554ad-4990-4ae5-9254-a40223fde077" released by "delete_volume" :: held 1.368s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:06:42 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-087d61c8-0899-4830-9cc1-2e7d2cc67b84 tempest-VolumeQuotasAdminTestJSON-1828718627 None] Created reservations ['d45b0dc1-6f0d-4c93-a07d-3b1e7c6e3724', '53888de6-7c3f-4e2a-8ee6-b90fcccafafd', '377d717f-9c5e-447f-8d0c-21fdec4882ce', '40d3afba-a055-4836-86c8-7a5eee896484'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:06:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-087d61c8-0899-4830-9cc1-2e7d2cc67b84 tempest-VolumeQuotasAdminTestJSON-1828718627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-087d61c8-0899-4830-9cc1-2e7d2cc67b84 tempest-VolumeQuotasAdminTestJSON-1828718627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:42 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-087d61c8-0899-4830-9cc1-2e7d2cc67b84 tempest-VolumeQuotasAdminTestJSON-1828718627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:06:42 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-087d61c8-0899-4830-9cc1-2e7d2cc67b84 tempest-VolumeQuotasAdminTestJSON-1828718627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:06:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-087d61c8-0899-4830-9cc1-2e7d2cc67b84 tempest-VolumeQuotasAdminTestJSON-1828718627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-087d61c8-0899-4830-9cc1-2e7d2cc67b84 tempest-VolumeQuotasAdminTestJSON-1828718627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:42 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:06:42 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:43 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-087d61c8-0899-4830-9cc1-2e7d2cc67b84 tempest-VolumeQuotasAdminTestJSON-1828718627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.663s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:43 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-087d61c8-0899-4830-9cc1-2e7d2cc67b84 tempest-VolumeQuotasAdminTestJSON-1828718627 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:06:43 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-087d61c8-0899-4830-9cc1-2e7d2cc67b84 tempest-VolumeQuotasAdminTestJSON-1828718627 None] Deleted volume successfully. Sep 05 05:06:43 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-087d61c8-0899-4830-9cc1-2e7d2cc67b84 tempest-VolumeQuotasAdminTestJSON-1828718627 None] Lock "cinder-898554ad-4990-4ae5-9254-a40223fde077-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:06:43 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-dab907ee-0bd7-4cd8-8eee-e41f70d5d391 req-663efad0-dc48-47cb-8760-ebf009f4dc20 tempest-ServerActionsTestOtherA-74061543 None] Terminate volume connection completed successfully. Sep 05 05:06:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-dab907ee-0bd7-4cd8-8eee-e41f70d5d391 req-663efad0-dc48-47cb-8760-ebf009f4dc20 tempest-ServerActionsTestOtherA-74061543 None] Deleting attachment 55f50dd1-b4cb-4f92-86f4-7146bd9ad1f7. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:06:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-dab907ee-0bd7-4cd8-8eee-e41f70d5d391 req-fb7e54ef-8a10-4523-8100-e9a55ea34c1e tempest-ServerActionsTestOtherA-74061543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-dab907ee-0bd7-4cd8-8eee-e41f70d5d391 req-fb7e54ef-8a10-4523-8100-e9a55ea34c1e tempest-ServerActionsTestOtherA-74061543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-dab907ee-0bd7-4cd8-8eee-e41f70d5d391 req-fb7e54ef-8a10-4523-8100-e9a55ea34c1e tempest-ServerActionsTestOtherA-74061543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-dab907ee-0bd7-4cd8-8eee-e41f70d5d391 req-fb7e54ef-8a10-4523-8100-e9a55ea34c1e tempest-ServerActionsTestOtherA-74061543 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136', 'name': 'volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2a55289-b98f-41d9-b59a-8f23c58b4da5', 'enforce_multipath': True} {{(pid=89331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 05:06:47 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-dab907ee-0bd7-4cd8-8eee-e41f70d5d391 req-fb7e54ef-8a10-4523-8100-e9a55ea34c1e tempest-ServerActionsTestOtherA-74061543 None] attachment_update completed successfully. Sep 05 05:06:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:06:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:06:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:06:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:49 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:06:49 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:50 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.624s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:50 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:06:50 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager._thread_info {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:06:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread count: 28 {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 05:06:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread info: [<_MainThread(MainThread, started 139182109970560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 05:06:51 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:06:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Flow 'volume_create_manager' (dc3956ba-e6c7-40da-abd7-cb837862b5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:06:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b37a5bf-8187-4c32-b882-3d8833673163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b37a5bf-8187-4c32-b882-3d8833673163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1410074501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46200b33-a370-4cac-8c74-e869d27ba1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be1a266934d471f9e126357f1fb918c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:06:52Z,use_quota=True,user_id='a0b149afd246419b88dcff8359582994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441ee97b-c3f2-4a51-8fad-03af2e63c48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441ee97b-c3f2-4a51-8fad-03af2e63c48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c4cda6-5f25-47a8-a93a-c2132f42ec44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c4cda6-5f25-47a8-a93a-c2132f42ec44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46200b33-a370-4cac-8c74-e869d27ba1dc', 'volume_name': 'volume-46200b33-a370-4cac-8c74-e869d27ba1dc', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e077a227-ec53-4e54-aa9a-83fd6ff9023b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e077a227-ec53-4e54-aa9a-83fd6ff9023b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7341d13-cfbb-4756-94a8-fb45b2aa0e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:52 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Volume 46200b33-a370-4cac-8c74-e869d27ba1dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46200b33-a370-4cac-8c74-e869d27ba1dc', 'volume_size': 1} Sep 05 05:06:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1410074501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46200b33-a370-4cac-8c74-e869d27ba1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be1a266934d471f9e126357f1fb918c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:06:52Z,use_quota=True,user_id='a0b149afd246419b88dcff8359582994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:06:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Creating volume 46200b33-a370-4cac-8c74-e869d27ba1dc {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:06:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:06:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:06:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:06:52 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:06:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:52 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc 1073741824 Sep 05 05:06:52 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:53 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc 1073741824" returned: 0 in 0.866s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:53 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc Sep 05 05:06:53 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:53 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc" returned: 0 in 0.326s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:06:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7341d13-cfbb-4756-94a8-fb45b2aa0e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46200b33-a370-4cac-8c74-e869d27ba1dc', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a293dbc4-6c57-4ece-af19-90af98492936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:06:53 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Volume volume-46200b33-a370-4cac-8c74-e869d27ba1dc (46200b33-a370-4cac-8c74-e869d27ba1dc): created successfully Sep 05 05:06:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a293dbc4-6c57-4ece-af19-90af98492936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:06:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Flow 'volume_create_manager' (dc3956ba-e6c7-40da-abd7-cb837862b5ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:06:53 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-66a93df0-584d-40d4-a524-da7c71fb0f4b req-4520c7cb-13fa-4bd5-906e-ecbece542a11 tempest-VolumesSnapshotsTestJSON-878843691 None] Created volume successfully. Sep 05 05:06:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-1a9d3ad4-01cb-43d2-ba24-ba246510d17e req-e7861895-261c-4399-a2c7-269c86d81bff tempest-VolumesSnapshotsTestJSON-878843691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:06:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-1a9d3ad4-01cb-43d2-ba24-ba246510d17e req-e7861895-261c-4399-a2c7-269c86d81bff tempest-VolumesSnapshotsTestJSON-878843691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:06:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [req-1a9d3ad4-01cb-43d2-ba24-ba246510d17e req-e7861895-261c-4399-a2c7-269c86d81bff tempest-VolumesSnapshotsTestJSON-878843691 None] Creating offline snapshot 3cf2aac4-ff87-4b3b-b575-6cbfd97581bf of volume 46200b33-a370-4cac-8c74-e869d27ba1dc {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:06:54 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d80ed6d-364e-4f10-be4a-27c5b7e2ec77]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:06:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-1a9d3ad4-01cb-43d2-ba24-ba246510d17e req-e7861895-261c-4399-a2c7-269c86d81bff tempest-VolumesSnapshotsTestJSON-878843691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:54 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc Sep 05 05:06:54 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:55 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-1a9d3ad4-01cb-43d2-ba24-ba246510d17e req-e7861895-261c-4399-a2c7-269c86d81bff tempest-VolumesSnapshotsTestJSON-878843691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc" returned: 0 in 0.602s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-1a9d3ad4-01cb-43d2-ba24-ba246510d17e req-e7861895-261c-4399-a2c7-269c86d81bff tempest-VolumesSnapshotsTestJSON-878843691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.3cf2aac4-ff87-4b3b-b575-6cbfd97581bf 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:55 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.3cf2aac4-ff87-4b3b-b575-6cbfd97581bf 1G Sep 05 05:06:55 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:55 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-1a9d3ad4-01cb-43d2-ba24-ba246510d17e req-e7861895-261c-4399-a2c7-269c86d81bff tempest-VolumesSnapshotsTestJSON-878843691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.3cf2aac4-ff87-4b3b-b575-6cbfd97581bf 1G" returned: 0 in 0.542s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-1a9d3ad4-01cb-43d2-ba24-ba246510d17e req-e7861895-261c-4399-a2c7-269c86d81bff tempest-VolumesSnapshotsTestJSON-878843691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46200b33-a370-4cac-8c74-e869d27ba1dc -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.3cf2aac4-ff87-4b3b-b575-6cbfd97581bf {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:55 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46200b33-a370-4cac-8c74-e869d27ba1dc -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.3cf2aac4-ff87-4b3b-b575-6cbfd97581bf Sep 05 05:06:55 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:56 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-1a9d3ad4-01cb-43d2-ba24-ba246510d17e req-e7861895-261c-4399-a2c7-269c86d81bff tempest-VolumesSnapshotsTestJSON-878843691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46200b33-a370-4cac-8c74-e869d27ba1dc -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.3cf2aac4-ff87-4b3b-b575-6cbfd97581bf" returned: 0 in 0.464s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:56 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [req-1a9d3ad4-01cb-43d2-ba24-ba246510d17e req-e7861895-261c-4399-a2c7-269c86d81bff tempest-VolumesSnapshotsTestJSON-878843691 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.3cf2aac4-ff87-4b3b-b575-6cbfd97581bf is being set with open permissions: ugo+rw Sep 05 05:06:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-1a9d3ad4-01cb-43d2-ba24-ba246510d17e req-e7861895-261c-4399-a2c7-269c86d81bff tempest-VolumesSnapshotsTestJSON-878843691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.3cf2aac4-ff87-4b3b-b575-6cbfd97581bf {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:56 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.3cf2aac4-ff87-4b3b-b575-6cbfd97581bf Sep 05 05:06:56 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:56 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-1a9d3ad4-01cb-43d2-ba24-ba246510d17e req-e7861895-261c-4399-a2c7-269c86d81bff tempest-VolumesSnapshotsTestJSON-878843691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.3cf2aac4-ff87-4b3b-b575-6cbfd97581bf" returned: 0 in 0.319s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-1a9d3ad4-01cb-43d2-ba24-ba246510d17e req-e7861895-261c-4399-a2c7-269c86d81bff tempest-VolumesSnapshotsTestJSON-878843691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:56 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.info Sep 05 05:06:56 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:56 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-1a9d3ad4-01cb-43d2-ba24-ba246510d17e req-e7861895-261c-4399-a2c7-269c86d81bff tempest-VolumesSnapshotsTestJSON-878843691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.info" returned: 0 in 0.360s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:56 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [req-1a9d3ad4-01cb-43d2-ba24-ba246510d17e req-e7861895-261c-4399-a2c7-269c86d81bff tempest-VolumesSnapshotsTestJSON-878843691 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.info is being set with open permissions: ugo+rw Sep 05 05:06:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-1a9d3ad4-01cb-43d2-ba24-ba246510d17e req-e7861895-261c-4399-a2c7-269c86d81bff tempest-VolumesSnapshotsTestJSON-878843691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:56 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.info Sep 05 05:06:56 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:57 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-1a9d3ad4-01cb-43d2-ba24-ba246510d17e req-e7861895-261c-4399-a2c7-269c86d81bff tempest-VolumesSnapshotsTestJSON-878843691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.info" returned: 0 in 0.431s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-1a9d3ad4-01cb-43d2-ba24-ba246510d17e req-e7861895-261c-4399-a2c7-269c86d81bff tempest-VolumesSnapshotsTestJSON-878843691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.840s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:06:57 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-1a9d3ad4-01cb-43d2-ba24-ba246510d17e req-e7861895-261c-4399-a2c7-269c86d81bff tempest-VolumesSnapshotsTestJSON-878843691 None] Create snapshot completed successfully Sep 05 05:06:58 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-62aadc7f-caeb-4fe0-b2be-b2bc4a6854f4 req-97520195-e90b-4ac8-bf2f-8381672bbcde tempest-VolumesSnapshotsTestJSON-878843691 None] Acquiring lock "cinder-3cf2aac4-ff87-4b3b-b575-6cbfd97581bf-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:06:58 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-62aadc7f-caeb-4fe0-b2be-b2bc4a6854f4 req-97520195-e90b-4ac8-bf2f-8381672bbcde tempest-VolumesSnapshotsTestJSON-878843691 None] Lock "cinder-3cf2aac4-ff87-4b3b-b575-6cbfd97581bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:06:58 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-62aadc7f-caeb-4fe0-b2be-b2bc4a6854f4 req-97520195-e90b-4ac8-bf2f-8381672bbcde tempest-VolumesSnapshotsTestJSON-878843691 None] Acquiring lock "cinder-quobyte-46200b33-a370-4cac-8c74-e869d27ba1dc" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:06:58 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-62aadc7f-caeb-4fe0-b2be-b2bc4a6854f4 req-97520195-e90b-4ac8-bf2f-8381672bbcde tempest-VolumesSnapshotsTestJSON-878843691 None] Lock "cinder-quobyte-46200b33-a370-4cac-8c74-e869d27ba1dc" acquired by "delete_snapshot" :: waited 0.056s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:06:58 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-62aadc7f-caeb-4fe0-b2be-b2bc4a6854f4 req-97520195-e90b-4ac8-bf2f-8381672bbcde tempest-VolumesSnapshotsTestJSON-878843691 None] Acquiring lock "cinder-quobyte-3cf2aac4-ff87-4b3b-b575-6cbfd97581bf" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:06:58 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-62aadc7f-caeb-4fe0-b2be-b2bc4a6854f4 req-97520195-e90b-4ac8-bf2f-8381672bbcde tempest-VolumesSnapshotsTestJSON-878843691 None] Lock "cinder-quobyte-3cf2aac4-ff87-4b3b-b575-6cbfd97581bf" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:06:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [req-62aadc7f-caeb-4fe0-b2be-b2bc4a6854f4 req-97520195-e90b-4ac8-bf2f-8381672bbcde tempest-VolumesSnapshotsTestJSON-878843691 None] Deleting offline snapshot 3cf2aac4-ff87-4b3b-b575-6cbfd97581bf of volume 46200b33-a370-4cac-8c74-e869d27ba1dc {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:06:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [req-62aadc7f-caeb-4fe0-b2be-b2bc4a6854f4 req-97520195-e90b-4ac8-bf2f-8381672bbcde tempest-VolumesSnapshotsTestJSON-878843691 None] snapshot_file for this snap is: volume-46200b33-a370-4cac-8c74-e869d27ba1dc.3cf2aac4-ff87-4b3b-b575-6cbfd97581bf {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:06:58 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7166e8ee-86ec-4218-8184-3150172bf5f0]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:06:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-62aadc7f-caeb-4fe0-b2be-b2bc4a6854f4 req-97520195-e90b-4ac8-bf2f-8381672bbcde tempest-VolumesSnapshotsTestJSON-878843691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.3cf2aac4-ff87-4b3b-b575-6cbfd97581bf {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:58 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.3cf2aac4-ff87-4b3b-b575-6cbfd97581bf Sep 05 05:06:58 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:59 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-62aadc7f-caeb-4fe0-b2be-b2bc4a6854f4 req-97520195-e90b-4ac8-bf2f-8381672bbcde tempest-VolumesSnapshotsTestJSON-878843691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.3cf2aac4-ff87-4b3b-b575-6cbfd97581bf" returned: 0 in 0.417s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:59 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [req-62aadc7f-caeb-4fe0-b2be-b2bc4a6854f4 req-97520195-e90b-4ac8-bf2f-8381672bbcde tempest-VolumesSnapshotsTestJSON-878843691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46200b33-a370-4cac-8c74-e869d27ba1dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:06:59 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[15173fdf-795d-4b50-878a-aaf4fc8628a4]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:06:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-62aadc7f-caeb-4fe0-b2be-b2bc4a6854f4 req-97520195-e90b-4ac8-bf2f-8381672bbcde tempest-VolumesSnapshotsTestJSON-878843691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:59 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc Sep 05 05:06:59 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:59 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-62aadc7f-caeb-4fe0-b2be-b2bc4a6854f4 req-97520195-e90b-4ac8-bf2f-8381672bbcde tempest-VolumesSnapshotsTestJSON-878843691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc" returned: 0 in 0.400s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-62aadc7f-caeb-4fe0-b2be-b2bc4a6854f4 req-97520195-e90b-4ac8-bf2f-8381672bbcde tempest-VolumesSnapshotsTestJSON-878843691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.3cf2aac4-ff87-4b3b-b575-6cbfd97581bf {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:59 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.3cf2aac4-ff87-4b3b-b575-6cbfd97581bf Sep 05 05:06:59 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:06:59 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Sep 05 05:06:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-62aadc7f-caeb-4fe0-b2be-b2bc4a6854f4 req-97520195-e90b-4ac8-bf2f-8381672bbcde tempest-VolumesSnapshotsTestJSON-878843691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.3cf2aac4-ff87-4b3b-b575-6cbfd97581bf" returned: 0 in 0.414s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:06:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-62aadc7f-caeb-4fe0-b2be-b2bc4a6854f4 req-97520195-e90b-4ac8-bf2f-8381672bbcde tempest-VolumesSnapshotsTestJSON-878843691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.3cf2aac4-ff87-4b3b-b575-6cbfd97581bf {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:06:59 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.3cf2aac4-ff87-4b3b-b575-6cbfd97581bf Sep 05 05:06:59 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:00 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-62aadc7f-caeb-4fe0-b2be-b2bc4a6854f4 req-97520195-e90b-4ac8-bf2f-8381672bbcde tempest-VolumesSnapshotsTestJSON-878843691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc.3cf2aac4-ff87-4b3b-b575-6cbfd97581bf" returned: 0 in 0.295s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:00 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-62aadc7f-caeb-4fe0-b2be-b2bc4a6854f4 req-97520195-e90b-4ac8-bf2f-8381672bbcde tempest-VolumesSnapshotsTestJSON-878843691 None] Lock "cinder-quobyte-3cf2aac4-ff87-4b3b-b575-6cbfd97581bf" released by "_delete_snapshot" :: held 1.683s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:00 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-62aadc7f-caeb-4fe0-b2be-b2bc4a6854f4 req-97520195-e90b-4ac8-bf2f-8381672bbcde tempest-VolumesSnapshotsTestJSON-878843691 None] Lock "cinder-quobyte-46200b33-a370-4cac-8c74-e869d27ba1dc" released by "delete_snapshot" :: held 1.753s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:00 devstack cinder-volume[89331]: DEBUG cinder.quota [req-62aadc7f-caeb-4fe0-b2be-b2bc4a6854f4 req-97520195-e90b-4ac8-bf2f-8381672bbcde tempest-VolumesSnapshotsTestJSON-878843691 None] Created reservations ['97292778-3e89-4d6f-bae4-cbaa2d0bc12b', 'ed02f6d6-ea6a-45d0-bcc1-4c925364a9ff', '2adbadf4-3ab7-48de-8a1f-14e6c41518ac', '30095e37-558e-43c2-964b-69522217eb5a'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:07:00 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-62aadc7f-caeb-4fe0-b2be-b2bc4a6854f4 req-97520195-e90b-4ac8-bf2f-8381672bbcde tempest-VolumesSnapshotsTestJSON-878843691 None] Delete snapshot completed successfully. Sep 05 05:07:00 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-62aadc7f-caeb-4fe0-b2be-b2bc4a6854f4 req-97520195-e90b-4ac8-bf2f-8381672bbcde tempest-VolumesSnapshotsTestJSON-878843691 None] Lock "cinder-3cf2aac4-ff87-4b3b-b575-6cbfd97581bf-delete_snapshot" released by "delete_snapshot" :: held 2.022s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:00 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-5ba0f893-09e1-487d-bbf0-fb7221ca803f req-40c40029-8d57-44d5-8d85-a79cd11f1ece tempest-VolumesSnapshotsTestJSON-878843691 None] Acquiring lock "cinder-46200b33-a370-4cac-8c74-e869d27ba1dc-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:00 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-5ba0f893-09e1-487d-bbf0-fb7221ca803f req-40c40029-8d57-44d5-8d85-a79cd11f1ece tempest-VolumesSnapshotsTestJSON-878843691 None] Lock "cinder-46200b33-a370-4cac-8c74-e869d27ba1dc-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:00 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Flow 'volume_create_manager' (93d47551-ad5e-46a5-a5da-8f4f848cf332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ee2c82-f7ca-4d6d-88a5-8921bf23de82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ee2c82-f7ca-4d6d-88a5-8921bf23de82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-191209021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=322918cb-ed87-46ca-980f-99562c61ba3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16cf223fa3e466096a97a3f568b8094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:07:01Z,use_quota=True,user_id='7210a9b8a9c54e46a15a82e0c7fd829b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4318b20a-8876-490a-9427-ca043ff12596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4318b20a-8876-490a-9427-ca043ff12596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cd4636-3a6e-4afd-b60f-2aee739f2bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cd4636-3a6e-4afd-b60f-2aee739f2bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '322918cb-ed87-46ca-980f-99562c61ba3d', 'volume_name': 'volume-322918cb-ed87-46ca-980f-99562c61ba3d', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33db0a60-1593-4a9f-b4a7-2ccd546c7c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33db0a60-1593-4a9f-b4a7-2ccd546c7c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0215b4c-4a5a-45c8-942d-1ba2da72e0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:01 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Volume 322918cb-ed87-46ca-980f-99562c61ba3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-322918cb-ed87-46ca-980f-99562c61ba3d', 'volume_size': 1} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-191209021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=322918cb-ed87-46ca-980f-99562c61ba3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16cf223fa3e466096a97a3f568b8094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:07:01Z,use_quota=True,user_id='7210a9b8a9c54e46a15a82e0c7fd829b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Creating volume 322918cb-ed87-46ca-980f-99562c61ba3d {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:07:01 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-322918cb-ed87-46ca-980f-99562c61ba3d 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-5ba0f893-09e1-487d-bbf0-fb7221ca803f req-40c40029-8d57-44d5-8d85-a79cd11f1ece tempest-VolumesSnapshotsTestJSON-878843691 None] Acquiring lock "cinder-quobyte-46200b33-a370-4cac-8c74-e869d27ba1dc" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:01 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-322918cb-ed87-46ca-980f-99562c61ba3d 1073741824 Sep 05 05:07:01 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-5ba0f893-09e1-487d-bbf0-fb7221ca803f req-40c40029-8d57-44d5-8d85-a79cd11f1ece tempest-VolumesSnapshotsTestJSON-878843691 None] Lock "cinder-quobyte-46200b33-a370-4cac-8c74-e869d27ba1dc" acquired by "delete_volume" :: waited 0.033s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7c03a1-ba60-4b92-a944-266aa64fa24d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-5ba0f893-09e1-487d-bbf0-fb7221ca803f req-40c40029-8d57-44d5-8d85-a79cd11f1ece tempest-VolumesSnapshotsTestJSON-878843691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:01 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc Sep 05 05:07:01 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:01 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-322918cb-ed87-46ca-980f-99562c61ba3d 1073741824" returned: 0 in 0.569s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:01 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-5ba0f893-09e1-487d-bbf0-fb7221ca803f req-40c40029-8d57-44d5-8d85-a79cd11f1ece tempest-VolumesSnapshotsTestJSON-878843691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc" returned: 0 in 0.497s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-5ba0f893-09e1-487d-bbf0-fb7221ca803f req-40c40029-8d57-44d5-8d85-a79cd11f1ece tempest-VolumesSnapshotsTestJSON-878843691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-322918cb-ed87-46ca-980f-99562c61ba3d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:01 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc Sep 05 05:07:01 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:01 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-322918cb-ed87-46ca-980f-99562c61ba3d Sep 05 05:07:01 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:02 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-5ba0f893-09e1-487d-bbf0-fb7221ca803f req-40c40029-8d57-44d5-8d85-a79cd11f1ece tempest-VolumesSnapshotsTestJSON-878843691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-46200b33-a370-4cac-8c74-e869d27ba1dc" returned: 0 in 0.324s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:02 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-5ba0f893-09e1-487d-bbf0-fb7221ca803f req-40c40029-8d57-44d5-8d85-a79cd11f1ece tempest-VolumesSnapshotsTestJSON-878843691 None] Lock "cinder-quobyte-46200b33-a370-4cac-8c74-e869d27ba1dc" released by "delete_volume" :: held 0.905s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:02 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-322918cb-ed87-46ca-980f-99562c61ba3d" returned: 0 in 0.396s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:07:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0215b4c-4a5a-45c8-942d-1ba2da72e0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-322918cb-ed87-46ca-980f-99562c61ba3d', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638d0df6-ba00-4948-a421-e760c00a0b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:02 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Volume volume-322918cb-ed87-46ca-980f-99562c61ba3d (322918cb-ed87-46ca-980f-99562c61ba3d): created successfully Sep 05 05:07:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638d0df6-ba00-4948-a421-e760c00a0b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Flow 'volume_create_manager' (93d47551-ad5e-46a5-a5da-8f4f848cf332) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:07:02 devstack cinder-volume[89331]: DEBUG cinder.quota [req-5ba0f893-09e1-487d-bbf0-fb7221ca803f req-40c40029-8d57-44d5-8d85-a79cd11f1ece tempest-VolumesSnapshotsTestJSON-878843691 None] Created reservations ['964ae2bf-62ed-4217-9d06-684f2ecbc4da', '099c4463-bde5-42ea-98d7-88101a523ebc', 'b6f36fdc-c1da-421b-b98d-547366dc7f20', '1a015e85-a428-4f26-9d8a-603d12eb4d12'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:07:02 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-b1080bde-c3c8-4e91-82a4-0841aafa8379 tempest-AttachVolumeNegativeTest-203049611 None] Created volume successfully. Sep 05 05:07:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-5ba0f893-09e1-487d-bbf0-fb7221ca803f req-40c40029-8d57-44d5-8d85-a79cd11f1ece tempest-VolumesSnapshotsTestJSON-878843691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-5ba0f893-09e1-487d-bbf0-fb7221ca803f req-40c40029-8d57-44d5-8d85-a79cd11f1ece tempest-VolumesSnapshotsTestJSON-878843691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [req-5ba0f893-09e1-487d-bbf0-fb7221ca803f req-40c40029-8d57-44d5-8d85-a79cd11f1ece tempest-VolumesSnapshotsTestJSON-878843691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:07:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [req-5ba0f893-09e1-487d-bbf0-fb7221ca803f req-40c40029-8d57-44d5-8d85-a79cd11f1ece tempest-VolumesSnapshotsTestJSON-878843691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:07:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-5ba0f893-09e1-487d-bbf0-fb7221ca803f req-40c40029-8d57-44d5-8d85-a79cd11f1ece tempest-VolumesSnapshotsTestJSON-878843691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-5ba0f893-09e1-487d-bbf0-fb7221ca803f req-40c40029-8d57-44d5-8d85-a79cd11f1ece tempest-VolumesSnapshotsTestJSON-878843691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:02 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:07:02 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:02 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-5ba0f893-09e1-487d-bbf0-fb7221ca803f req-40c40029-8d57-44d5-8d85-a79cd11f1ece tempest-VolumesSnapshotsTestJSON-878843691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.279s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:02 devstack cinder-volume[89331]: DEBUG cinder.manager [req-5ba0f893-09e1-487d-bbf0-fb7221ca803f req-40c40029-8d57-44d5-8d85-a79cd11f1ece tempest-VolumesSnapshotsTestJSON-878843691 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:07:02 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-5ba0f893-09e1-487d-bbf0-fb7221ca803f req-40c40029-8d57-44d5-8d85-a79cd11f1ece tempest-VolumesSnapshotsTestJSON-878843691 None] Deleted volume successfully. Sep 05 05:07:02 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-5ba0f893-09e1-487d-bbf0-fb7221ca803f req-40c40029-8d57-44d5-8d85-a79cd11f1ece tempest-VolumesSnapshotsTestJSON-878843691 None] Lock "cinder-46200b33-a370-4cac-8c74-e869d27ba1dc-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-557e16bf-de72-402e-a6c5-a74d86cf512d req-b392d397-3352-4872-8fcb-2d14c83a897d tempest-AttachVolumeNegativeTest-203049611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-557e16bf-de72-402e-a6c5-a74d86cf512d req-b392d397-3352-4872-8fcb-2d14c83a897d tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-557e16bf-de72-402e-a6c5-a74d86cf512d req-b392d397-3352-4872-8fcb-2d14c83a897d tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-557e16bf-de72-402e-a6c5-a74d86cf512d req-b392d397-3352-4872-8fcb-2d14c83a897d tempest-AttachVolumeNegativeTest-203049611 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136', 'name': 'volume-322918cb-ed87-46ca-980f-99562c61ba3d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1fec1c5f-2562-4fbd-9501-10ea4db8f3ed', 'enforce_multipath': True} {{(pid=89331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 05:07:04 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-557e16bf-de72-402e-a6c5-a74d86cf512d req-b392d397-3352-4872-8fcb-2d14c83a897d tempest-AttachVolumeNegativeTest-203049611 None] attachment_update completed successfully. Sep 05 05:07:07 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-aa5015c4-a6c4-46f2-afea-47eeda3d5b09 req-83bbb902-953d-4716-ae92-add4d22ab603 tempest-AttachVolumeNegativeTest-203049611 None] Terminate volume connection completed successfully. Sep 05 05:07:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-aa5015c4-a6c4-46f2-afea-47eeda3d5b09 req-83bbb902-953d-4716-ae92-add4d22ab603 tempest-AttachVolumeNegativeTest-203049611 None] Deleting attachment 1fec1c5f-2562-4fbd-9501-10ea4db8f3ed. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Flow 'volume_create_manager' (87d59931-4d86-4c32-9aa5-1ce423d235c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (276af558-d09c-4a13-ac78-96c5086c6448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (276af558-d09c-4a13-ac78-96c5086c6448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1065475207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='90f13433b7c845379dfff0d47daa8074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:07:09Z,use_quota=True,user_id='8af0e95b95d346ef89548337c161b2f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e85f0f-7068-4f7b-8fa5-61713764843a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e85f0f-7068-4f7b-8fa5-61713764843a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f3243c-13bb-4eec-a6f9-ca89a2553510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f3243c-13bb-4eec-a6f9-ca89a2553510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43', 'volume_name': 'volume-a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352a7e71-27a3-470d-b070-8bc0b5ffdbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352a7e71-27a3-470d-b070-8bc0b5ffdbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4891cd-b472-48c0-ac06-411498bb1ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:09 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Volume a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43', 'volume_size': 1} Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1065475207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='90f13433b7c845379dfff0d47daa8074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:07:09Z,use_quota=True,user_id='8af0e95b95d346ef89548337c161b2f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Creating volume a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:07:09 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:09 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43 1073741824 Sep 05 05:07:09 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:09 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43 1073741824" returned: 0 in 0.605s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:09 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43 Sep 05 05:07:09 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:10 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43" returned: 0 in 0.278s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:07:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4891cd-b472-48c0-ac06-411498bb1ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e1fc2de-1871-4ddc-9adf-3252bf453076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:10 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Volume volume-a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43 (a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43): created successfully Sep 05 05:07:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e1fc2de-1871-4ddc-9adf-3252bf453076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Flow 'volume_create_manager' (87d59931-4d86-4c32-9aa5-1ce423d235c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:07:10 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-8e8e4eea-d4db-4074-b4f2-47a7fab9e54e req-268ca264-be67-4bc3-92fa-5a2c1e30528c tempest-VolumesGetTestJSON-1665285525 None] Created volume successfully. Sep 05 05:07:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-b1bf3540-4b7f-429b-b79e-43e89076e7e1 req-011f0928-8e39-4741-94bf-8e32b39709f7 tempest-VolumesGetTestJSON-1665285525 None] Acquiring lock "cinder-a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-b1bf3540-4b7f-429b-b79e-43e89076e7e1 req-011f0928-8e39-4741-94bf-8e32b39709f7 tempest-VolumesGetTestJSON-1665285525 None] Lock "cinder-a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-b1bf3540-4b7f-429b-b79e-43e89076e7e1 req-011f0928-8e39-4741-94bf-8e32b39709f7 tempest-VolumesGetTestJSON-1665285525 None] Acquiring lock "cinder-quobyte-a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-b1bf3540-4b7f-429b-b79e-43e89076e7e1 req-011f0928-8e39-4741-94bf-8e32b39709f7 tempest-VolumesGetTestJSON-1665285525 None] Lock "cinder-quobyte-a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43" acquired by "delete_volume" :: waited 0.028s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:10 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9d2a37-4e52-49c8-a192-a9690fc0b377]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:07:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-b1bf3540-4b7f-429b-b79e-43e89076e7e1 req-011f0928-8e39-4741-94bf-8e32b39709f7 tempest-VolumesGetTestJSON-1665285525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:10 devstack sudo[97225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43 Sep 05 05:07:10 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:11 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-b1bf3540-4b7f-429b-b79e-43e89076e7e1 req-011f0928-8e39-4741-94bf-8e32b39709f7 tempest-VolumesGetTestJSON-1665285525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43" returned: 0 in 0.521s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-b1bf3540-4b7f-429b-b79e-43e89076e7e1 req-011f0928-8e39-4741-94bf-8e32b39709f7 tempest-VolumesGetTestJSON-1665285525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:11 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43 Sep 05 05:07:11 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:11 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-b1bf3540-4b7f-429b-b79e-43e89076e7e1 req-011f0928-8e39-4741-94bf-8e32b39709f7 tempest-VolumesGetTestJSON-1665285525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43" returned: 0 in 0.291s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-b1bf3540-4b7f-429b-b79e-43e89076e7e1 req-011f0928-8e39-4741-94bf-8e32b39709f7 tempest-VolumesGetTestJSON-1665285525 None] Lock "cinder-quobyte-a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43" released by "delete_volume" :: held 0.876s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:11 devstack cinder-volume[89331]: DEBUG cinder.quota [req-b1bf3540-4b7f-429b-b79e-43e89076e7e1 req-011f0928-8e39-4741-94bf-8e32b39709f7 tempest-VolumesGetTestJSON-1665285525 None] Created reservations ['4871097f-39a5-4e33-bf12-4bee8a35556c', 'f75282d3-83bf-4997-ad7b-eb5736c80039', 'a8b31cd9-e9ab-42b4-821a-7822ee8a26f6', '27edb98b-347d-4d9d-96ad-8e20fbd30b84'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:07:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-b1bf3540-4b7f-429b-b79e-43e89076e7e1 req-011f0928-8e39-4741-94bf-8e32b39709f7 tempest-VolumesGetTestJSON-1665285525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-b1bf3540-4b7f-429b-b79e-43e89076e7e1 req-011f0928-8e39-4741-94bf-8e32b39709f7 tempest-VolumesGetTestJSON-1665285525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [req-b1bf3540-4b7f-429b-b79e-43e89076e7e1 req-011f0928-8e39-4741-94bf-8e32b39709f7 tempest-VolumesGetTestJSON-1665285525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:07:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [req-b1bf3540-4b7f-429b-b79e-43e89076e7e1 req-011f0928-8e39-4741-94bf-8e32b39709f7 tempest-VolumesGetTestJSON-1665285525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:07:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-b1bf3540-4b7f-429b-b79e-43e89076e7e1 req-011f0928-8e39-4741-94bf-8e32b39709f7 tempest-VolumesGetTestJSON-1665285525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-b1bf3540-4b7f-429b-b79e-43e89076e7e1 req-011f0928-8e39-4741-94bf-8e32b39709f7 tempest-VolumesGetTestJSON-1665285525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:11 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:07:11 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:12 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-b1bf3540-4b7f-429b-b79e-43e89076e7e1 req-011f0928-8e39-4741-94bf-8e32b39709f7 tempest-VolumesGetTestJSON-1665285525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.303s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:12 devstack cinder-volume[89331]: DEBUG cinder.manager [req-b1bf3540-4b7f-429b-b79e-43e89076e7e1 req-011f0928-8e39-4741-94bf-8e32b39709f7 tempest-VolumesGetTestJSON-1665285525 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:07:12 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-b1bf3540-4b7f-429b-b79e-43e89076e7e1 req-011f0928-8e39-4741-94bf-8e32b39709f7 tempest-VolumesGetTestJSON-1665285525 None] Deleted volume successfully. Sep 05 05:07:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-b1bf3540-4b7f-429b-b79e-43e89076e7e1 req-011f0928-8e39-4741-94bf-8e32b39709f7 tempest-VolumesGetTestJSON-1665285525 None] Lock "cinder-a74f5b56-9c8d-4f4c-a5bf-624cb7d76e43-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:14 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-cf80c118-071e-42c4-8dc9-698d7d5cde4c tempest-AttachVolumeNegativeTest-203049611 None] Acquiring lock "cinder-322918cb-ed87-46ca-980f-99562c61ba3d-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:14 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-cf80c118-071e-42c4-8dc9-698d7d5cde4c tempest-AttachVolumeNegativeTest-203049611 None] Lock "cinder-322918cb-ed87-46ca-980f-99562c61ba3d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:14 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-cf80c118-071e-42c4-8dc9-698d7d5cde4c tempest-AttachVolumeNegativeTest-203049611 None] Acquiring lock "cinder-quobyte-322918cb-ed87-46ca-980f-99562c61ba3d" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:14 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-cf80c118-071e-42c4-8dc9-698d7d5cde4c tempest-AttachVolumeNegativeTest-203049611 None] Lock "cinder-quobyte-322918cb-ed87-46ca-980f-99562c61ba3d" acquired by "delete_volume" :: waited 0.016s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:14 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8aea0a-5bb3-457d-9575-112e9717ade7]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:07:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-cf80c118-071e-42c4-8dc9-698d7d5cde4c tempest-AttachVolumeNegativeTest-203049611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-322918cb-ed87-46ca-980f-99562c61ba3d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:14 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-322918cb-ed87-46ca-980f-99562c61ba3d Sep 05 05:07:14 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:14 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-cf80c118-071e-42c4-8dc9-698d7d5cde4c tempest-AttachVolumeNegativeTest-203049611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-322918cb-ed87-46ca-980f-99562c61ba3d" returned: 0 in 0.536s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-cf80c118-071e-42c4-8dc9-698d7d5cde4c tempest-AttachVolumeNegativeTest-203049611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-322918cb-ed87-46ca-980f-99562c61ba3d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:15 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-322918cb-ed87-46ca-980f-99562c61ba3d Sep 05 05:07:15 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:15 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-cf80c118-071e-42c4-8dc9-698d7d5cde4c tempest-AttachVolumeNegativeTest-203049611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-322918cb-ed87-46ca-980f-99562c61ba3d" returned: 0 in 0.312s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-cf80c118-071e-42c4-8dc9-698d7d5cde4c tempest-AttachVolumeNegativeTest-203049611 None] Lock "cinder-quobyte-322918cb-ed87-46ca-980f-99562c61ba3d" released by "delete_volume" :: held 0.921s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:15 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-cf80c118-071e-42c4-8dc9-698d7d5cde4c tempest-AttachVolumeNegativeTest-203049611 None] Created reservations ['a627e4f2-8cda-4b50-ba06-447ebd16cfa4', 'cb1401e5-2154-4040-b6d2-8bea3c2a3a3d', '88d4b07d-343f-4df8-9502-bf6719c834b4', 'ee383f23-584d-4e89-85b5-e45542796d63'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:07:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-cf80c118-071e-42c4-8dc9-698d7d5cde4c tempest-AttachVolumeNegativeTest-203049611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-cf80c118-071e-42c4-8dc9-698d7d5cde4c tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:15 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-cf80c118-071e-42c4-8dc9-698d7d5cde4c tempest-AttachVolumeNegativeTest-203049611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:07:15 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-cf80c118-071e-42c4-8dc9-698d7d5cde4c tempest-AttachVolumeNegativeTest-203049611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:07:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-cf80c118-071e-42c4-8dc9-698d7d5cde4c tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-cf80c118-071e-42c4-8dc9-698d7d5cde4c tempest-AttachVolumeNegativeTest-203049611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:15 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:07:15 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:15 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-cf80c118-071e-42c4-8dc9-698d7d5cde4c tempest-AttachVolumeNegativeTest-203049611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.286s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:15 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-cf80c118-071e-42c4-8dc9-698d7d5cde4c tempest-AttachVolumeNegativeTest-203049611 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:07:15 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-cf80c118-071e-42c4-8dc9-698d7d5cde4c tempest-AttachVolumeNegativeTest-203049611 None] Deleted volume successfully. Sep 05 05:07:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-cf80c118-071e-42c4-8dc9-698d7d5cde4c tempest-AttachVolumeNegativeTest-203049611 None] Lock "cinder-322918cb-ed87-46ca-980f-99562c61ba3d-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6630edf5-c44b-4763-8e8b-a6c12ea5fca6 tempest-AttachVolumeNegativeTest-203049611 None] Acquiring lock "cinder-d9293273-1223-45b8-bc5b-a5348c4527db-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6630edf5-c44b-4763-8e8b-a6c12ea5fca6 tempest-AttachVolumeNegativeTest-203049611 None] Lock "cinder-d9293273-1223-45b8-bc5b-a5348c4527db-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6630edf5-c44b-4763-8e8b-a6c12ea5fca6 tempest-AttachVolumeNegativeTest-203049611 None] Acquiring lock "cinder-quobyte-d9293273-1223-45b8-bc5b-a5348c4527db" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6630edf5-c44b-4763-8e8b-a6c12ea5fca6 tempest-AttachVolumeNegativeTest-203049611 None] Lock "cinder-quobyte-d9293273-1223-45b8-bc5b-a5348c4527db" acquired by "delete_volume" :: waited 0.017s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:16 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[78934de3-6ebe-4a17-b62c-8a335b32b059]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:07:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6630edf5-c44b-4763-8e8b-a6c12ea5fca6 tempest-AttachVolumeNegativeTest-203049611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9293273-1223-45b8-bc5b-a5348c4527db {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:17 devstack sudo[97253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9293273-1223-45b8-bc5b-a5348c4527db Sep 05 05:07:17 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:17 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6630edf5-c44b-4763-8e8b-a6c12ea5fca6 tempest-AttachVolumeNegativeTest-203049611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9293273-1223-45b8-bc5b-a5348c4527db" returned: 0 in 0.478s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6630edf5-c44b-4763-8e8b-a6c12ea5fca6 tempest-AttachVolumeNegativeTest-203049611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9293273-1223-45b8-bc5b-a5348c4527db {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:17 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9293273-1223-45b8-bc5b-a5348c4527db Sep 05 05:07:17 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:17 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6630edf5-c44b-4763-8e8b-a6c12ea5fca6 tempest-AttachVolumeNegativeTest-203049611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d9293273-1223-45b8-bc5b-a5348c4527db" returned: 0 in 0.390s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:17 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-5105fdbf-d9f5-4c7d-848b-1b4e6cea8f94 tempest-GroupSnapshotsTest-1729556448 None] Group tempest-GroupSnapshotsTest-Group-1672708949: creating Sep 05 05:07:17 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6630edf5-c44b-4763-8e8b-a6c12ea5fca6 tempest-AttachVolumeNegativeTest-203049611 None] Lock "cinder-quobyte-d9293273-1223-45b8-bc5b-a5348c4527db" released by "delete_volume" :: held 0.936s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:17 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-5105fdbf-d9f5-4c7d-848b-1b4e6cea8f94 tempest-GroupSnapshotsTest-1729556448 None] Group tempest-GroupSnapshotsTest-Group-1672708949: created successfully Sep 05 05:07:17 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-5105fdbf-d9f5-4c7d-848b-1b4e6cea8f94 tempest-GroupSnapshotsTest-1729556448 None] Create group completed successfully. Sep 05 05:07:17 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-6630edf5-c44b-4763-8e8b-a6c12ea5fca6 tempest-AttachVolumeNegativeTest-203049611 None] Created reservations ['2d3904bb-aa82-4bc9-a42a-0ffb627b1bad', '934257df-4bce-49c3-a79b-ec67c843e8d1', '63dfc34a-cb25-4e1a-b1fd-c1ea7636106a', '61a9c0b1-8aa5-4848-a65f-445182f24a96'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:07:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6630edf5-c44b-4763-8e8b-a6c12ea5fca6 tempest-AttachVolumeNegativeTest-203049611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6630edf5-c44b-4763-8e8b-a6c12ea5fca6 tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6630edf5-c44b-4763-8e8b-a6c12ea5fca6 tempest-AttachVolumeNegativeTest-203049611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:07:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6630edf5-c44b-4763-8e8b-a6c12ea5fca6 tempest-AttachVolumeNegativeTest-203049611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:07:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6630edf5-c44b-4763-8e8b-a6c12ea5fca6 tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6630edf5-c44b-4763-8e8b-a6c12ea5fca6 tempest-AttachVolumeNegativeTest-203049611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:18 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:07:18 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:18 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6630edf5-c44b-4763-8e8b-a6c12ea5fca6 tempest-AttachVolumeNegativeTest-203049611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.311s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:18 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-6630edf5-c44b-4763-8e8b-a6c12ea5fca6 tempest-AttachVolumeNegativeTest-203049611 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:07:18 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-6630edf5-c44b-4763-8e8b-a6c12ea5fca6 tempest-AttachVolumeNegativeTest-203049611 None] Deleted volume successfully. Sep 05 05:07:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6630edf5-c44b-4763-8e8b-a6c12ea5fca6 tempest-AttachVolumeNegativeTest-203049611 None] Lock "cinder-d9293273-1223-45b8-bc5b-a5348c4527db-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:19 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-bf28a923-9289-4b77-84f0-90f883c309b0 tempest-AttachVolumeNegativeTest-203049611 None] Acquiring lock "cinder-d890488e-c1b6-4060-aed4-caaed3eaca63-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:19 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-bf28a923-9289-4b77-84f0-90f883c309b0 tempest-AttachVolumeNegativeTest-203049611 None] Lock "cinder-d890488e-c1b6-4060-aed4-caaed3eaca63-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:19 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-bf28a923-9289-4b77-84f0-90f883c309b0 tempest-AttachVolumeNegativeTest-203049611 None] Acquiring lock "cinder-quobyte-d890488e-c1b6-4060-aed4-caaed3eaca63" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:19 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-bf28a923-9289-4b77-84f0-90f883c309b0 tempest-AttachVolumeNegativeTest-203049611 None] Lock "cinder-quobyte-d890488e-c1b6-4060-aed4-caaed3eaca63" acquired by "delete_volume" :: waited 0.028s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:19 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[68983836-cf95-427c-aa13-05b43018e469]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:07:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bf28a923-9289-4b77-84f0-90f883c309b0 tempest-AttachVolumeNegativeTest-203049611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d890488e-c1b6-4060-aed4-caaed3eaca63 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:19 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:07:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Flow 'volume_create_manager' (75cb1bd8-d261-4313-ae3a-3ddbbbbc05d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:07:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83c7bdd-f06f-4535-826c-f5435a2edb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:20 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d890488e-c1b6-4060-aed4-caaed3eaca63 Sep 05 05:07:20 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83c7bdd-f06f-4535-826c-f5435a2edb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-348190267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=174cf226-eb3a-4630-8da6-1122524ff779,host='devstack@QuobyteHD#QuobyteHD',id=63e07305-6820-4c30-81db-555b09d3915c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e7c3bc65d5437086628b49624199d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:07:20Z,use_quota=True,user_id='aecb10d760de47aab00d0cc7fc05dd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d901e6f-d75f-4e83-af60-06f59a5662e0),volume_type_id=2d901e6f-d75f-4e83-af60-06f59a5662e0)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b96c3f-7c89-4a33-8ed3-31dd5a475b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b96c3f-7c89-4a33-8ed3-31dd5a475b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a0cccc-9fe0-4d32-b4ec-499cf34617f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a0cccc-9fe0-4d32-b4ec-499cf34617f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63e07305-6820-4c30-81db-555b09d3915c', 'volume_name': 'volume-63e07305-6820-4c30-81db-555b09d3915c', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129f560f-6405-4210-b5e9-4df72b05ef89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129f560f-6405-4210-b5e9-4df72b05ef89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3d3a06-e139-47da-b260-cde32dc05fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:20 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Volume 63e07305-6820-4c30-81db-555b09d3915c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63e07305-6820-4c30-81db-555b09d3915c', 'volume_size': 1} Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=174cf226-eb3a-4630-8da6-1122524ff779,created_at=2026-09-05T03:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-348190267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=174cf226-eb3a-4630-8da6-1122524ff779,host='devstack@QuobyteHD#QuobyteHD',id=63e07305-6820-4c30-81db-555b09d3915c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e7c3bc65d5437086628b49624199d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:07:20Z,use_quota=True,user_id='aecb10d760de47aab00d0cc7fc05dd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d901e6f-d75f-4e83-af60-06f59a5662e0),volume_type_id=2d901e6f-d75f-4e83-af60-06f59a5662e0)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Creating volume 63e07305-6820-4c30-81db-555b09d3915c {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:07:20 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:20 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c 1073741824 Sep 05 05:07:20 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:20 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bf28a923-9289-4b77-84f0-90f883c309b0 tempest-AttachVolumeNegativeTest-203049611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d890488e-c1b6-4060-aed4-caaed3eaca63" returned: 0 in 0.505s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bf28a923-9289-4b77-84f0-90f883c309b0 tempest-AttachVolumeNegativeTest-203049611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d890488e-c1b6-4060-aed4-caaed3eaca63 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:20 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d890488e-c1b6-4060-aed4-caaed3eaca63 Sep 05 05:07:20 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:20 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bf28a923-9289-4b77-84f0-90f883c309b0 tempest-AttachVolumeNegativeTest-203049611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d890488e-c1b6-4060-aed4-caaed3eaca63" returned: 0 in 0.407s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-bf28a923-9289-4b77-84f0-90f883c309b0 tempest-AttachVolumeNegativeTest-203049611 None] Lock "cinder-quobyte-d890488e-c1b6-4060-aed4-caaed3eaca63" released by "delete_volume" :: held 1.001s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:20 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c 1073741824" returned: 0 in 0.664s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:20 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-bf28a923-9289-4b77-84f0-90f883c309b0 tempest-AttachVolumeNegativeTest-203049611 None] Created reservations ['4798475e-472c-4351-a8fb-6f54de873f94', '0abcda98-dcfe-4028-af74-e1bfc43e63eb', '3ae6f6b7-9b29-4550-ad80-e36012cddf89', 'd7ccfac8-d4cf-49fe-9b11-d62bbc84ba0a'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:07:20 devstack sudo[97316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c Sep 05 05:07:20 devstack sudo[97316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-bf28a923-9289-4b77-84f0-90f883c309b0 tempest-AttachVolumeNegativeTest-203049611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-bf28a923-9289-4b77-84f0-90f883c309b0 tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-bf28a923-9289-4b77-84f0-90f883c309b0 tempest-AttachVolumeNegativeTest-203049611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:07:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-bf28a923-9289-4b77-84f0-90f883c309b0 tempest-AttachVolumeNegativeTest-203049611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:07:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-bf28a923-9289-4b77-84f0-90f883c309b0 tempest-AttachVolumeNegativeTest-203049611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bf28a923-9289-4b77-84f0-90f883c309b0 tempest-AttachVolumeNegativeTest-203049611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:21 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:07:21 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:21 devstack sudo[97316]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c" returned: 0 in 0.542s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:07:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3d3a06-e139-47da-b260-cde32dc05fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63e07305-6820-4c30-81db-555b09d3915c', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e74f2826-f07f-455f-bc95-5484bbd9810a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:21 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:21 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Volume volume-63e07305-6820-4c30-81db-555b09d3915c (63e07305-6820-4c30-81db-555b09d3915c): created successfully Sep 05 05:07:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e74f2826-f07f-455f-bc95-5484bbd9810a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Flow 'volume_create_manager' (75cb1bd8-d261-4313-ae3a-3ddbbbbc05d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:07:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bf28a923-9289-4b77-84f0-90f883c309b0 tempest-AttachVolumeNegativeTest-203049611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.407s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:21 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-bf28a923-9289-4b77-84f0-90f883c309b0 tempest-AttachVolumeNegativeTest-203049611 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:07:21 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-997d8224-a0ae-4a36-9f49-91d28c3b57f0 tempest-GroupSnapshotsTest-1729556448 None] Created volume successfully. Sep 05 05:07:21 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-bf28a923-9289-4b77-84f0-90f883c309b0 tempest-AttachVolumeNegativeTest-203049611 None] Deleted volume successfully. Sep 05 05:07:21 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-571fb658-db1c-4bf0-acac-11d7980fd7ae req-679a0417-c9ed-4665-acae-000b0cd135b3 tempest-ServerActionsTestOtherA-74061543 None] Terminate volume connection completed successfully. Sep 05 05:07:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-571fb658-db1c-4bf0-acac-11d7980fd7ae req-679a0417-c9ed-4665-acae-000b0cd135b3 tempest-ServerActionsTestOtherA-74061543 None] Deleting attachment c2a55289-b98f-41d9-b59a-8f23c58b4da5. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:07:21 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-bf28a923-9289-4b77-84f0-90f883c309b0 tempest-AttachVolumeNegativeTest-203049611 None] Lock "cinder-d890488e-c1b6-4060-aed4-caaed3eaca63-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:21 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-571fb658-db1c-4bf0-acac-11d7980fd7ae req-412991d5-f352-4268-a15b-fe6b892039a7 tempest-ServerActionsTestOtherA-74061543 None] Acquiring lock "cinder-e5913549-be6d-4464-b9cc-8e4ff6f7d17e-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:21 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-571fb658-db1c-4bf0-acac-11d7980fd7ae req-412991d5-f352-4268-a15b-fe6b892039a7 tempest-ServerActionsTestOtherA-74061543 None] Lock "cinder-e5913549-be6d-4464-b9cc-8e4ff6f7d17e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:21 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-571fb658-db1c-4bf0-acac-11d7980fd7ae req-412991d5-f352-4268-a15b-fe6b892039a7 tempest-ServerActionsTestOtherA-74061543 None] Acquiring lock "cinder-quobyte-e5913549-be6d-4464-b9cc-8e4ff6f7d17e" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:21 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-571fb658-db1c-4bf0-acac-11d7980fd7ae req-412991d5-f352-4268-a15b-fe6b892039a7 tempest-ServerActionsTestOtherA-74061543 None] Lock "cinder-quobyte-e5913549-be6d-4464-b9cc-8e4ff6f7d17e" acquired by "delete_volume" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:21 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[75764081-2335-4936-b137-246803bb6884]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:07:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-571fb658-db1c-4bf0-acac-11d7980fd7ae req-412991d5-f352-4268-a15b-fe6b892039a7 tempest-ServerActionsTestOtherA-74061543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:22 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e Sep 05 05:07:22 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:22 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-571fb658-db1c-4bf0-acac-11d7980fd7ae req-412991d5-f352-4268-a15b-fe6b892039a7 tempest-ServerActionsTestOtherA-74061543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e" returned: 0 in 0.722s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-571fb658-db1c-4bf0-acac-11d7980fd7ae req-412991d5-f352-4268-a15b-fe6b892039a7 tempest-ServerActionsTestOtherA-74061543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:22 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e Sep 05 05:07:22 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:22 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-9a4f5563-9dc4-40e7-a28b-4adf4113f23f tempest-GroupSnapshotsTest-1729556448 None] GroupSnapshot 178685e3-fc86-4088-97ab-97026d0d92ef: creating. Sep 05 05:07:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9a4f5563-9dc4-40e7-a28b-4adf4113f23f tempest-GroupSnapshotsTest-1729556448 None] Group snapshot 178685e3-fc86-4088-97ab-97026d0d92ef: creating. {{(pid=89331) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 05 05:07:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9a4f5563-9dc4-40e7-a28b-4adf4113f23f tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9a4f5563-9dc4-40e7-a28b-4adf4113f23f tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-9a4f5563-9dc4-40e7-a28b-4adf4113f23f tempest-GroupSnapshotsTest-1729556448 None] Creating offline snapshot 3c3fe90d-6668-43e7-99cf-ea999667642d of volume 63e07305-6820-4c30-81db-555b09d3915c {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:07:23 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8f4189-eb13-4e8c-9f57-d56e2af24cbe]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:07:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a4f5563-9dc4-40e7-a28b-4adf4113f23f tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:23 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-571fb658-db1c-4bf0-acac-11d7980fd7ae req-412991d5-f352-4268-a15b-fe6b892039a7 tempest-ServerActionsTestOtherA-74061543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e5913549-be6d-4464-b9cc-8e4ff6f7d17e" returned: 0 in 0.426s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:23 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-571fb658-db1c-4bf0-acac-11d7980fd7ae req-412991d5-f352-4268-a15b-fe6b892039a7 tempest-ServerActionsTestOtherA-74061543 None] Lock "cinder-quobyte-e5913549-be6d-4464-b9cc-8e4ff6f7d17e" released by "delete_volume" :: held 1.226s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:23 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c Sep 05 05:07:23 devstack cinder-volume[89331]: DEBUG cinder.quota [req-571fb658-db1c-4bf0-acac-11d7980fd7ae req-412991d5-f352-4268-a15b-fe6b892039a7 tempest-ServerActionsTestOtherA-74061543 None] Created reservations ['061da40c-585b-4f34-9af9-abaeff257828', 'bf0e839a-bca8-4b74-b95c-a9f3752ebc2d', '01f93087-21cb-4d1d-a14e-4e852fe47468', '7e3bd52f-77ed-4f0d-b719-07ac587fb857'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:07:23 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-571fb658-db1c-4bf0-acac-11d7980fd7ae req-412991d5-f352-4268-a15b-fe6b892039a7 tempest-ServerActionsTestOtherA-74061543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-571fb658-db1c-4bf0-acac-11d7980fd7ae req-412991d5-f352-4268-a15b-fe6b892039a7 tempest-ServerActionsTestOtherA-74061543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [req-571fb658-db1c-4bf0-acac-11d7980fd7ae req-412991d5-f352-4268-a15b-fe6b892039a7 tempest-ServerActionsTestOtherA-74061543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:07:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [req-571fb658-db1c-4bf0-acac-11d7980fd7ae req-412991d5-f352-4268-a15b-fe6b892039a7 tempest-ServerActionsTestOtherA-74061543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:07:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-571fb658-db1c-4bf0-acac-11d7980fd7ae req-412991d5-f352-4268-a15b-fe6b892039a7 tempest-ServerActionsTestOtherA-74061543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-571fb658-db1c-4bf0-acac-11d7980fd7ae req-412991d5-f352-4268-a15b-fe6b892039a7 tempest-ServerActionsTestOtherA-74061543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:23 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:07:23 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:23 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a4f5563-9dc4-40e7-a28b-4adf4113f23f tempest-GroupSnapshotsTest-1729556448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c" returned: 0 in 0.514s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a4f5563-9dc4-40e7-a28b-4adf4113f23f tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.3c3fe90d-6668-43e7-99cf-ea999667642d 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:23 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-571fb658-db1c-4bf0-acac-11d7980fd7ae req-412991d5-f352-4268-a15b-fe6b892039a7 tempest-ServerActionsTestOtherA-74061543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.308s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:23 devstack cinder-volume[89331]: DEBUG cinder.manager [req-571fb658-db1c-4bf0-acac-11d7980fd7ae req-412991d5-f352-4268-a15b-fe6b892039a7 tempest-ServerActionsTestOtherA-74061543 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:07:23 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-571fb658-db1c-4bf0-acac-11d7980fd7ae req-412991d5-f352-4268-a15b-fe6b892039a7 tempest-ServerActionsTestOtherA-74061543 None] Deleted volume successfully. Sep 05 05:07:23 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.3c3fe90d-6668-43e7-99cf-ea999667642d 1G Sep 05 05:07:23 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:23 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-571fb658-db1c-4bf0-acac-11d7980fd7ae req-412991d5-f352-4268-a15b-fe6b892039a7 tempest-ServerActionsTestOtherA-74061543 None] Lock "cinder-e5913549-be6d-4464-b9cc-8e4ff6f7d17e-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:24 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-92ec12ee-0be9-4314-af50-e1247e5908db tempest-ServerActionsTestOtherA-74061543 None] Acquiring lock "cinder-d2bbce93-7d90-4bd3-813a-78278e327329-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:24 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-92ec12ee-0be9-4314-af50-e1247e5908db tempest-ServerActionsTestOtherA-74061543 None] Lock "cinder-d2bbce93-7d90-4bd3-813a-78278e327329-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:24 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-92ec12ee-0be9-4314-af50-e1247e5908db tempest-ServerActionsTestOtherA-74061543 None] Acquiring lock "cinder-quobyte-d2bbce93-7d90-4bd3-813a-78278e327329" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:24 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a4f5563-9dc4-40e7-a28b-4adf4113f23f tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.3c3fe90d-6668-43e7-99cf-ea999667642d 1G" returned: 0 in 0.611s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a4f5563-9dc4-40e7-a28b-4adf4113f23f tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63e07305-6820-4c30-81db-555b09d3915c -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.3c3fe90d-6668-43e7-99cf-ea999667642d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:24 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-92ec12ee-0be9-4314-af50-e1247e5908db tempest-ServerActionsTestOtherA-74061543 None] Lock "cinder-quobyte-d2bbce93-7d90-4bd3-813a-78278e327329" acquired by "delete_volume" :: waited 0.039s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:24 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63e07305-6820-4c30-81db-555b09d3915c -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.3c3fe90d-6668-43e7-99cf-ea999667642d Sep 05 05:07:24 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:24 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48b972d-4e4b-47ef-8c50-98d4e0ede83d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:07:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-92ec12ee-0be9-4314-af50-e1247e5908db tempest-ServerActionsTestOtherA-74061543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d2bbce93-7d90-4bd3-813a-78278e327329 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:24 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d2bbce93-7d90-4bd3-813a-78278e327329 Sep 05 05:07:24 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:24 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a4f5563-9dc4-40e7-a28b-4adf4113f23f tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63e07305-6820-4c30-81db-555b09d3915c -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.3c3fe90d-6668-43e7-99cf-ea999667642d" returned: 0 in 0.385s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:24 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-9a4f5563-9dc4-40e7-a28b-4adf4113f23f tempest-GroupSnapshotsTest-1729556448 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.3c3fe90d-6668-43e7-99cf-ea999667642d is being set with open permissions: ugo+rw: NotImplementedError Sep 05 05:07:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a4f5563-9dc4-40e7-a28b-4adf4113f23f tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.3c3fe90d-6668-43e7-99cf-ea999667642d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:24 devstack sudo[97362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.3c3fe90d-6668-43e7-99cf-ea999667642d Sep 05 05:07:24 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:24 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-92ec12ee-0be9-4314-af50-e1247e5908db tempest-ServerActionsTestOtherA-74061543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d2bbce93-7d90-4bd3-813a-78278e327329" returned: 0 in 0.454s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-92ec12ee-0be9-4314-af50-e1247e5908db tempest-ServerActionsTestOtherA-74061543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d2bbce93-7d90-4bd3-813a-78278e327329 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:24 devstack sudo[97368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d2bbce93-7d90-4bd3-813a-78278e327329 Sep 05 05:07:24 devstack sudo[97368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:24 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a4f5563-9dc4-40e7-a28b-4adf4113f23f tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.3c3fe90d-6668-43e7-99cf-ea999667642d" returned: 0 in 0.316s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a4f5563-9dc4-40e7-a28b-4adf4113f23f tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:24 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.info Sep 05 05:07:24 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:25 devstack sudo[97368]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-92ec12ee-0be9-4314-af50-e1247e5908db tempest-ServerActionsTestOtherA-74061543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d2bbce93-7d90-4bd3-813a-78278e327329" returned: 0 in 0.372s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:25 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-92ec12ee-0be9-4314-af50-e1247e5908db tempest-ServerActionsTestOtherA-74061543 None] Lock "cinder-quobyte-d2bbce93-7d90-4bd3-813a-78278e327329" released by "delete_volume" :: held 0.914s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:25 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-92ec12ee-0be9-4314-af50-e1247e5908db tempest-ServerActionsTestOtherA-74061543 None] Created reservations ['06682702-e1ce-44d3-98b5-bcf421b093b1', '78b4588a-b5fc-4581-bc32-548bf8e0bafd', 'b0a4fcf7-49e6-4d90-8fce-14d32e2947e5', 'f2434693-00c0-4ba7-a3f0-ca01f8f8408b'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:07:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-92ec12ee-0be9-4314-af50-e1247e5908db tempest-ServerActionsTestOtherA-74061543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-92ec12ee-0be9-4314-af50-e1247e5908db tempest-ServerActionsTestOtherA-74061543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-92ec12ee-0be9-4314-af50-e1247e5908db tempest-ServerActionsTestOtherA-74061543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:07:25 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-92ec12ee-0be9-4314-af50-e1247e5908db tempest-ServerActionsTestOtherA-74061543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:07:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-92ec12ee-0be9-4314-af50-e1247e5908db tempest-ServerActionsTestOtherA-74061543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-92ec12ee-0be9-4314-af50-e1247e5908db tempest-ServerActionsTestOtherA-74061543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a4f5563-9dc4-40e7-a28b-4adf4113f23f tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.info" returned: 0 in 0.431s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:25 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-9a4f5563-9dc4-40e7-a28b-4adf4113f23f tempest-GroupSnapshotsTest-1729556448 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 05:07:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a4f5563-9dc4-40e7-a28b-4adf4113f23f tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:25 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:07:25 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:25 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.info Sep 05 05:07:25 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:25 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-92ec12ee-0be9-4314-af50-e1247e5908db tempest-ServerActionsTestOtherA-74061543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.281s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:25 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-92ec12ee-0be9-4314-af50-e1247e5908db tempest-ServerActionsTestOtherA-74061543 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:07:25 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-92ec12ee-0be9-4314-af50-e1247e5908db tempest-ServerActionsTestOtherA-74061543 None] Deleted volume successfully. Sep 05 05:07:25 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a4f5563-9dc4-40e7-a28b-4adf4113f23f tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.info" returned: 0 in 0.284s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9a4f5563-9dc4-40e7-a28b-4adf4113f23f tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.681s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:25 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-92ec12ee-0be9-4314-af50-e1247e5908db tempest-ServerActionsTestOtherA-74061543 None] Lock "cinder-d2bbce93-7d90-4bd3-813a-78278e327329-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:25 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-9a4f5563-9dc4-40e7-a28b-4adf4113f23f tempest-GroupSnapshotsTest-1729556448 None] group_snapshot 178685e3-fc86-4088-97ab-97026d0d92ef: created successfully Sep 05 05:07:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "cinder-quobyte-3c3fe90d-6668-43e7-99cf-ea999667642d-d85b2660-5763-48aa-a707-80debdcb18d0" by "_create_volume_from_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-3c3fe90d-6668-43e7-99cf-ea999667642d-d85b2660-5763-48aa-a707-80debdcb18d0" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Creating volume d85b2660-5763-48aa-a707-80debdcb18d0 from snapshot 3c3fe90d-6668-43e7-99cf-ea999667642d {{(pid=89331) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 05:07:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:07:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:07:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:07:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "cinder-quobyte-d85b2660-5763-48aa-a707-80debdcb18d0" by "_copy_volume_from_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-d85b2660-5763-48aa-a707-80debdcb18d0" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] snapshot: 3c3fe90d-6668-43e7-99cf-ea999667642d, volume: d85b2660-5763-48aa-a707-80debdcb18d0, {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 05:07:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:07:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:07:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:27 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdf6ae2-a6ab-4d4f-a317-43d3f07d0cad]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:07:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.3c3fe90d-6668-43e7-99cf-ea999667642d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:27 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.3c3fe90d-6668-43e7-99cf-ea999667642d Sep 05 05:07:27 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:27 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.3c3fe90d-6668-43e7-99cf-ea999667642d" returned: 0 in 0.536s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63e07305-6820-4c30-81db-555b09d3915c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:07:28 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7727aeb-5ec0-4d7c-bff9-e7ff98522bfd]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:07:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:28 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c Sep 05 05:07:28 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:28 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c" returned: 0 in 0.418s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 05:07:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Creating direct copy from snapshot {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 05:07:28 devstack cinder-volume[89331]: DEBUG cinder.utils [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Path /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d85b2660-5763-48aa-a707-80debdcb18d0 not found in is_blk_device check {{(pid=89331) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 05:07:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d85b2660-5763-48aa-a707-80debdcb18d0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:28 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d85b2660-5763-48aa-a707-80debdcb18d0 Sep 05 05:07:28 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:35 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d85b2660-5763-48aa-a707-80debdcb18d0" returned: 0 in 6.591s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:35 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c, size 1024.00 MB, duration 6.59 sec, destination /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d85b2660-5763-48aa-a707-80debdcb18d0 {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:07:35 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Converted 1024.00 MB image at 155.33 MB/s Sep 05 05:07:35 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d85b2660-5763-48aa-a707-80debdcb18d0 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 05:07:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d85b2660-5763-48aa-a707-80debdcb18d0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:35 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d85b2660-5763-48aa-a707-80debdcb18d0 Sep 05 05:07:35 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:35 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d85b2660-5763-48aa-a707-80debdcb18d0" returned: 0 in 0.274s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:35 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-d85b2660-5763-48aa-a707-80debdcb18d0" released by "_copy_volume_from_snapshot" :: held 7.942s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:35 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=87,cinder:INSERT=21,cinder:UPDATE=104,cinder:DELETE=6 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:07:35 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=92,cinder:INSERT=26,cinder:UPDATE=95,cinder:DELETE=9 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:07:35 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-3c3fe90d-6668-43e7-99cf-ea999667642d-d85b2660-5763-48aa-a707-80debdcb18d0" released by "_create_volume_from_snapshot" :: held 8.043s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.064s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:35 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-6c002a4a-3d27-4c7b-b5bf-1483a0e7e8c8 tempest-GroupSnapshotsTest-1729556448 None] Create group from source-snapshot-178685e3-fc86-4088-97ab-97026d0d92ef completed successfully. Sep 05 05:07:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-33c887a2-6b03-4a65-9085-a7808793925c tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "cinder-quobyte-d85b2660-5763-48aa-a707-80debdcb18d0" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-33c887a2-6b03-4a65-9085-a7808793925c tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-d85b2660-5763-48aa-a707-80debdcb18d0" acquired by "delete_volume" :: waited 0.028s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:36 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddec3f9e-53d4-40e9-b853-20ad94528dc0]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:07:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-33c887a2-6b03-4a65-9085-a7808793925c tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d85b2660-5763-48aa-a707-80debdcb18d0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:37 devstack sudo[97437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d85b2660-5763-48aa-a707-80debdcb18d0 Sep 05 05:07:37 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:37 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-33c887a2-6b03-4a65-9085-a7808793925c tempest-GroupSnapshotsTest-1729556448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d85b2660-5763-48aa-a707-80debdcb18d0" returned: 0 in 0.680s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-33c887a2-6b03-4a65-9085-a7808793925c tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d85b2660-5763-48aa-a707-80debdcb18d0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:37 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d85b2660-5763-48aa-a707-80debdcb18d0 Sep 05 05:07:37 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:37 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-33c887a2-6b03-4a65-9085-a7808793925c tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d85b2660-5763-48aa-a707-80debdcb18d0" returned: 0 in 0.380s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-33c887a2-6b03-4a65-9085-a7808793925c tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-d85b2660-5763-48aa-a707-80debdcb18d0" released by "delete_volume" :: held 1.132s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:38 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-33c887a2-6b03-4a65-9085-a7808793925c tempest-GroupSnapshotsTest-1729556448 None] Created reservations ['0f92b66c-1bc2-4090-b910-85fed2a2d940'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:07:38 devstack cinder-volume[89331]: WARNING cinder.quota [None req-33c887a2-6b03-4a65-9085-a7808793925c tempest-GroupSnapshotsTest-1729556448 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2052823522 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2052823522, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:07:38 devstack cinder-volume[89331]: WARNING cinder.quota [None req-33c887a2-6b03-4a65-9085-a7808793925c tempest-GroupSnapshotsTest-1729556448 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2052823522 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2052823522, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:07:38 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-33c887a2-6b03-4a65-9085-a7808793925c tempest-GroupSnapshotsTest-1729556448 None] Created reservations ['f05b1dfd-21cc-4fe9-836e-161b4ecec1b4', 'fff12185-f85f-4898-8fe1-ce45858306b2', '1ee75afc-fbc3-4280-8e66-ebf59e18793c', '5dcc8c98-ed59-4db1-9173-a05bb2283c63'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:07:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-33c887a2-6b03-4a65-9085-a7808793925c tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-33c887a2-6b03-4a65-9085-a7808793925c tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:38 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-33c887a2-6b03-4a65-9085-a7808793925c tempest-GroupSnapshotsTest-1729556448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:07:38 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-33c887a2-6b03-4a65-9085-a7808793925c tempest-GroupSnapshotsTest-1729556448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:07:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-33c887a2-6b03-4a65-9085-a7808793925c tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-33c887a2-6b03-4a65-9085-a7808793925c tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:38 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:07:38 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:38 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-33c887a2-6b03-4a65-9085-a7808793925c tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.380s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:38 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-33c887a2-6b03-4a65-9085-a7808793925c tempest-GroupSnapshotsTest-1729556448 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:07:38 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-33c887a2-6b03-4a65-9085-a7808793925c tempest-GroupSnapshotsTest-1729556448 None] Delete group completed successfully. Sep 05 05:07:39 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-b552c2dd-69d4-4799-a495-efca000b3c30 tempest-GroupSnapshotsTest-1729556448 None] group_snapshot 178685e3-fc86-4088-97ab-97026d0d92ef: deleting Sep 05 05:07:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b552c2dd-69d4-4799-a495-efca000b3c30 tempest-GroupSnapshotsTest-1729556448 None] group_snapshot 178685e3-fc86-4088-97ab-97026d0d92ef: deleting {{(pid=89331) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 05 05:07:39 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b552c2dd-69d4-4799-a495-efca000b3c30 tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "cinder-quobyte-63e07305-6820-4c30-81db-555b09d3915c" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:39 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b552c2dd-69d4-4799-a495-efca000b3c30 tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-63e07305-6820-4c30-81db-555b09d3915c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:39 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b552c2dd-69d4-4799-a495-efca000b3c30 tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "cinder-quobyte-3c3fe90d-6668-43e7-99cf-ea999667642d" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:39 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b552c2dd-69d4-4799-a495-efca000b3c30 tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-3c3fe90d-6668-43e7-99cf-ea999667642d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-b552c2dd-69d4-4799-a495-efca000b3c30 tempest-GroupSnapshotsTest-1729556448 None] Deleting offline snapshot 3c3fe90d-6668-43e7-99cf-ea999667642d of volume 63e07305-6820-4c30-81db-555b09d3915c {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:07:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-b552c2dd-69d4-4799-a495-efca000b3c30 tempest-GroupSnapshotsTest-1729556448 None] snapshot_file for this snap is: volume-63e07305-6820-4c30-81db-555b09d3915c.3c3fe90d-6668-43e7-99cf-ea999667642d {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:07:39 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8460d96-538a-450c-bafb-2ef0569c4d06]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:07:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b552c2dd-69d4-4799-a495-efca000b3c30 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.3c3fe90d-6668-43e7-99cf-ea999667642d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:39 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.3c3fe90d-6668-43e7-99cf-ea999667642d Sep 05 05:07:39 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:40 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b552c2dd-69d4-4799-a495-efca000b3c30 tempest-GroupSnapshotsTest-1729556448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.3c3fe90d-6668-43e7-99cf-ea999667642d" returned: 0 in 0.466s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:40 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-b552c2dd-69d4-4799-a495-efca000b3c30 tempest-GroupSnapshotsTest-1729556448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63e07305-6820-4c30-81db-555b09d3915c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:07:40 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4209aa0-9584-4e28-8d02-f0992fbeb19f]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:07:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b552c2dd-69d4-4799-a495-efca000b3c30 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:40 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c Sep 05 05:07:40 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:40 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b552c2dd-69d4-4799-a495-efca000b3c30 tempest-GroupSnapshotsTest-1729556448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c" returned: 0 in 0.744s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b552c2dd-69d4-4799-a495-efca000b3c30 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.3c3fe90d-6668-43e7-99cf-ea999667642d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:40 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.3c3fe90d-6668-43e7-99cf-ea999667642d Sep 05 05:07:40 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:41 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b552c2dd-69d4-4799-a495-efca000b3c30 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.3c3fe90d-6668-43e7-99cf-ea999667642d" returned: 0 in 0.637s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b552c2dd-69d4-4799-a495-efca000b3c30 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.3c3fe90d-6668-43e7-99cf-ea999667642d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:41 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.3c3fe90d-6668-43e7-99cf-ea999667642d Sep 05 05:07:41 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:42 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b552c2dd-69d4-4799-a495-efca000b3c30 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c.3c3fe90d-6668-43e7-99cf-ea999667642d" returned: 0 in 0.462s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:42 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b552c2dd-69d4-4799-a495-efca000b3c30 tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-3c3fe90d-6668-43e7-99cf-ea999667642d" released by "_delete_snapshot" :: held 2.513s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:42 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b552c2dd-69d4-4799-a495-efca000b3c30 tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-63e07305-6820-4c30-81db-555b09d3915c" released by "delete_snapshot" :: held 2.538s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:42 devstack cinder-volume[89331]: WARNING cinder.quota [None req-b552c2dd-69d4-4799-a495-efca000b3c30 tempest-GroupSnapshotsTest-1729556448 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2052823522 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2052823522, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:07:42 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-b552c2dd-69d4-4799-a495-efca000b3c30 tempest-GroupSnapshotsTest-1729556448 None] Created reservations ['c1aa39e9-6590-4c0c-b7c1-137fd350f1d8', '1f377c80-b2fe-44f9-8dba-5c762c1b2210', '53a4ba06-0bd0-4433-869a-efc9360b6b83', 'faca9fa4-54c0-462d-b926-ab00200eea5b'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:07:42 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-b552c2dd-69d4-4799-a495-efca000b3c30 tempest-GroupSnapshotsTest-1729556448 None] group_snapshot 178685e3-fc86-4088-97ab-97026d0d92ef: deleted successfully Sep 05 05:07:43 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-da182620-df92-41e7-aa48-d3043174b755 tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "cinder-quobyte-63e07305-6820-4c30-81db-555b09d3915c" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:43 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-da182620-df92-41e7-aa48-d3043174b755 tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-63e07305-6820-4c30-81db-555b09d3915c" acquired by "delete_volume" :: waited 0.026s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:43 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17457d4-d6d4-4963-b508-79afd00ce859]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:07:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-da182620-df92-41e7-aa48-d3043174b755 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:43 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c Sep 05 05:07:43 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:44 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-da182620-df92-41e7-aa48-d3043174b755 tempest-GroupSnapshotsTest-1729556448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c" returned: 0 in 0.551s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-da182620-df92-41e7-aa48-d3043174b755 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:44 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c Sep 05 05:07:44 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:44 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-da182620-df92-41e7-aa48-d3043174b755 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63e07305-6820-4c30-81db-555b09d3915c" returned: 0 in 0.267s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-da182620-df92-41e7-aa48-d3043174b755 tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-63e07305-6820-4c30-81db-555b09d3915c" released by "delete_volume" :: held 0.906s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:44 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-da182620-df92-41e7-aa48-d3043174b755 tempest-GroupSnapshotsTest-1729556448 None] Created reservations ['a8bef3fb-cb37-4bde-b83e-26ab085e59e9'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:07:44 devstack cinder-volume[89331]: WARNING cinder.db.api [None req-da182620-df92-41e7-aa48-d3043174b755 tempest-GroupSnapshotsTest-1729556448 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2052823522'] Sep 05 05:07:44 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-da182620-df92-41e7-aa48-d3043174b755 tempest-GroupSnapshotsTest-1729556448 None] Created reservations ['7ae5fa17-69e6-4c15-bb23-26a2c0bf7a2e', '21dccae5-d8b8-4c55-a7cd-e8cfbecf8f70', 'bd8cab19-da0f-4ef5-89ed-fd14bc3b0ff4', 'fa6105ae-a845-4851-8065-796a573389c1'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:07:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-da182620-df92-41e7-aa48-d3043174b755 tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-da182620-df92-41e7-aa48-d3043174b755 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:44 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-da182620-df92-41e7-aa48-d3043174b755 tempest-GroupSnapshotsTest-1729556448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:07:44 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-da182620-df92-41e7-aa48-d3043174b755 tempest-GroupSnapshotsTest-1729556448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:07:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-da182620-df92-41e7-aa48-d3043174b755 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-da182620-df92-41e7-aa48-d3043174b755 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:45 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:07:45 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:45 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-da182620-df92-41e7-aa48-d3043174b755 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.519s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:45 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-da182620-df92-41e7-aa48-d3043174b755 tempest-GroupSnapshotsTest-1729556448 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:07:45 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-da182620-df92-41e7-aa48-d3043174b755 tempest-GroupSnapshotsTest-1729556448 None] Delete group completed successfully. Sep 05 05:07:46 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-617864a4-17f3-43ef-8b82-dff1a8a53823 tempest-GroupSnapshotsTest-1729556448 None] Group tempest-GroupSnapshotsTest-Group-613748728: creating Sep 05 05:07:46 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-617864a4-17f3-43ef-8b82-dff1a8a53823 tempest-GroupSnapshotsTest-1729556448 None] Group tempest-GroupSnapshotsTest-Group-613748728: created successfully Sep 05 05:07:46 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-617864a4-17f3-43ef-8b82-dff1a8a53823 tempest-GroupSnapshotsTest-1729556448 None] Create group completed successfully. Sep 05 05:07:48 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:07:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Flow 'volume_create_manager' (5bed80d6-cd2a-4a9d-9df5-c1354a9d69fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:07:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9352dcbd-5223-4540-8c97-a182065ca47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9352dcbd-5223-4540-8c97-a182065ca47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2109236845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=890e29b0-65ed-466d-9010-d053b7031d4e,host='devstack@QuobyteHD#QuobyteHD',id=6d0ec410-bc8f-482a-aa10-b46e6ff5078c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e7c3bc65d5437086628b49624199d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:07:49Z,use_quota=True,user_id='aecb10d760de47aab00d0cc7fc05dd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fe2c3f6-5322-4e00-a004-a98747623624),volume_type_id=5fe2c3f6-5322-4e00-a004-a98747623624)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de49a086-28f1-49b9-aa24-5813683740d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de49a086-28f1-49b9-aa24-5813683740d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f71338-8292-4119-8196-7c6551fadd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f71338-8292-4119-8196-7c6551fadd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d0ec410-bc8f-482a-aa10-b46e6ff5078c', 'volume_name': 'volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82579b2f-19c0-435c-9ba7-f42c33ce38b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82579b2f-19c0-435c-9ba7-f42c33ce38b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb22ce0d-fc38-4dd8-a529-33e9edce8c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:48 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Volume 6d0ec410-bc8f-482a-aa10-b46e6ff5078c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c', 'volume_size': 1} Sep 05 05:07:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=890e29b0-65ed-466d-9010-d053b7031d4e,created_at=2026-09-05T03:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2109236845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=890e29b0-65ed-466d-9010-d053b7031d4e,host='devstack@QuobyteHD#QuobyteHD',id=6d0ec410-bc8f-482a-aa10-b46e6ff5078c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e7c3bc65d5437086628b49624199d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:07:49Z,use_quota=True,user_id='aecb10d760de47aab00d0cc7fc05dd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fe2c3f6-5322-4e00-a004-a98747623624),volume_type_id=5fe2c3f6-5322-4e00-a004-a98747623624)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:07:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Creating volume 6d0ec410-bc8f-482a-aa10-b46e6ff5078c {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:07:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:07:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:07:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:07:48 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:07:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:48 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c 1073741824 Sep 05 05:07:48 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:49 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c 1073741824" returned: 0 in 0.674s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:07:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:07:49 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c Sep 05 05:07:49 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:07:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:49 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:07:49 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:50 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c" returned: 0 in 0.473s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb22ce0d-fc38-4dd8-a529-33e9edce8c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f084c9a1-623c-42ec-ad16-abcacf43cab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:50 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Volume volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c (6d0ec410-bc8f-482a-aa10-b46e6ff5078c): created successfully Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f084c9a1-623c-42ec-ad16-abcacf43cab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Flow 'volume_create_manager' (5bed80d6-cd2a-4a9d-9df5-c1354a9d69fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:07:50 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-dc739100-0cab-47e5-a9ab-24f0865cda54 tempest-GroupSnapshotsTest-1729556448 None] Created volume successfully. Sep 05 05:07:50 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.696s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager._thread_info {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread count: 28 {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread info: [<_MainThread(MainThread, started 139182109970560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Flow 'volume_create_manager' (dd852eac-11e3-4c52-bd6c-ebf393641ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23466637-3661-48bb-ad3b-a8c8d6ebb232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23466637-3661-48bb-ad3b-a8c8d6ebb232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-791686705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99dc7a42-ef52-4f68-9703-3f31b1a99e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80930effaa3b4b0fa26cc55d32c5292b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:07:51Z,use_quota=True,user_id='acac602cc4644dc98ca1bab773db38ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef85971-a01e-4a0b-87c1-f974c9526232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef85971-a01e-4a0b-87c1-f974c9526232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88845626-106e-49b6-a394-59bfbc2a0ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88845626-106e-49b6-a394-59bfbc2a0ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99dc7a42-ef52-4f68-9703-3f31b1a99e71', 'volume_name': 'volume-99dc7a42-ef52-4f68-9703-3f31b1a99e71', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbbf4827-6174-4349-9dd6-320211068a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbbf4827-6174-4349-9dd6-320211068a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff4cfde-b51e-4260-b4c5-bb64517d51c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:50 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Volume 99dc7a42-ef52-4f68-9703-3f31b1a99e71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99dc7a42-ef52-4f68-9703-3f31b1a99e71', 'volume_size': 1} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-791686705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99dc7a42-ef52-4f68-9703-3f31b1a99e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80930effaa3b4b0fa26cc55d32c5292b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:07:51Z,use_quota=True,user_id='acac602cc4644dc98ca1bab773db38ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Creating volume 99dc7a42-ef52-4f68-9703-3f31b1a99e71 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:07:50 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:07:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-99dc7a42-ef52-4f68-9703-3f31b1a99e71 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:50 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-99dc7a42-ef52-4f68-9703-3f31b1a99e71 1073741824 Sep 05 05:07:50 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:51 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-99dc7a42-ef52-4f68-9703-3f31b1a99e71 1073741824" returned: 0 in 0.622s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-99dc7a42-ef52-4f68-9703-3f31b1a99e71 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:51 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-99dc7a42-ef52-4f68-9703-3f31b1a99e71 Sep 05 05:07:51 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:52 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-99dc7a42-ef52-4f68-9703-3f31b1a99e71" returned: 0 in 0.511s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff4cfde-b51e-4260-b4c5-bb64517d51c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99dc7a42-ef52-4f68-9703-3f31b1a99e71', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b4b084f-2c07-454a-872f-05a91dfe4416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:52 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Volume volume-99dc7a42-ef52-4f68-9703-3f31b1a99e71 (99dc7a42-ef52-4f68-9703-3f31b1a99e71): created successfully Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b4b084f-2c07-454a-872f-05a91dfe4416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Flow 'volume_create_manager' (dd852eac-11e3-4c52-bd6c-ebf393641ab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:07:52 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-fd95e032-fd53-455e-a995-f29171752ba7 tempest-VolumesActionsTest-818028394 None] Created volume successfully. Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Flow 'volume_create_manager' (77ba4f11-fab9-4376-ae72-2edd5e74bcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d13f9652-2ba5-4920-9c51-f50036080f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d13f9652-2ba5-4920-9c51-f50036080f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-264430275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=890e29b0-65ed-466d-9010-d053b7031d4e,host='devstack@QuobyteHD#QuobyteHD',id=7e6188c5-11ca-45e9-a05f-37ef16feb911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e7c3bc65d5437086628b49624199d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:07:52Z,use_quota=True,user_id='aecb10d760de47aab00d0cc7fc05dd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fe2c3f6-5322-4e00-a004-a98747623624),volume_type_id=5fe2c3f6-5322-4e00-a004-a98747623624)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd65a3c-0bd8-40a3-9e3b-8db27463e81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd65a3c-0bd8-40a3-9e3b-8db27463e81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287ce423-a627-43a7-9368-3a89025a8377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287ce423-a627-43a7-9368-3a89025a8377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e6188c5-11ca-45e9-a05f-37ef16feb911', 'volume_name': 'volume-7e6188c5-11ca-45e9-a05f-37ef16feb911', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4873c28-a958-4c41-92ab-10c6a7b1c767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4873c28-a958-4c41-92ab-10c6a7b1c767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e6523b-5d63-49f0-bfcf-22c3145713e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:52 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Volume 7e6188c5-11ca-45e9-a05f-37ef16feb911: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e6188c5-11ca-45e9-a05f-37ef16feb911', 'volume_size': 1} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=890e29b0-65ed-466d-9010-d053b7031d4e,created_at=2026-09-05T03:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-264430275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=890e29b0-65ed-466d-9010-d053b7031d4e,host='devstack@QuobyteHD#QuobyteHD',id=7e6188c5-11ca-45e9-a05f-37ef16feb911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e7c3bc65d5437086628b49624199d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:07:52Z,use_quota=True,user_id='aecb10d760de47aab00d0cc7fc05dd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fe2c3f6-5322-4e00-a004-a98747623624),volume_type_id=5fe2c3f6-5322-4e00-a004-a98747623624)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Creating volume 7e6188c5-11ca-45e9-a05f-37ef16feb911 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:07:52 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:07:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:52 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911 1073741824 Sep 05 05:07:52 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:53 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-c49e4745-b1cb-43a1-8c40-a2761d4f31a2 tempest-GroupsV320Test-766618150 None] Group tempest-GroupsV320Test-Group-1102788225: creating Sep 05 05:07:53 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-c49e4745-b1cb-43a1-8c40-a2761d4f31a2 tempest-GroupsV320Test-766618150 None] Group tempest-GroupsV320Test-Group-1102788225: created successfully Sep 05 05:07:53 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-c49e4745-b1cb-43a1-8c40-a2761d4f31a2 tempest-GroupsV320Test-766618150 None] Create group completed successfully. Sep 05 05:07:53 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911 1073741824" returned: 0 in 0.767s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:53 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d147a263-bdfb-4eee-b8a9-422067a35fb1 tempest-VolumesActionsTest-818028394 None] Acquiring lock "cinder-99dc7a42-ef52-4f68-9703-3f31b1a99e71" by "attach_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:53 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911 Sep 05 05:07:53 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:53 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d147a263-bdfb-4eee-b8a9-422067a35fb1 tempest-VolumesActionsTest-818028394 None] Lock "cinder-99dc7a42-ef52-4f68-9703-3f31b1a99e71" acquired by "attach_volume" :: waited 0.028s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:53 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-d147a263-bdfb-4eee-b8a9-422067a35fb1 tempest-VolumesActionsTest-818028394 None] Attaching volume 99dc7a42-ef52-4f68-9703-3f31b1a99e71 to instance 003ed9a0-e0e1-4da0-bb50-745dedf6dfc0 at mountpoint /dev/vdb on host None. Sep 05 05:07:53 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-d147a263-bdfb-4eee-b8a9-422067a35fb1 tempest-VolumesActionsTest-818028394 None] Attach volume completed successfully. Sep 05 05:07:53 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d147a263-bdfb-4eee-b8a9-422067a35fb1 tempest-VolumesActionsTest-818028394 None] Lock "cinder-99dc7a42-ef52-4f68-9703-3f31b1a99e71" released by "attach_volume" :: held 0.174s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:54 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911" returned: 0 in 0.657s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:07:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e6523b-5d63-49f0-bfcf-22c3145713e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e6188c5-11ca-45e9-a05f-37ef16feb911', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdd800e-de47-4fb4-aeba-667ebe72cbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:07:54 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Volume volume-7e6188c5-11ca-45e9-a05f-37ef16feb911 (7e6188c5-11ca-45e9-a05f-37ef16feb911): created successfully Sep 05 05:07:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdd800e-de47-4fb4-aeba-667ebe72cbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:07:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Flow 'volume_create_manager' (77ba4f11-fab9-4376-ae72-2edd5e74bcd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:07:54 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-b3a9aefa-53f5-49f1-a710-df562f989fca tempest-GroupSnapshotsTest-1729556448 None] Created volume successfully. Sep 05 05:07:54 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-8a7e3b22-e640-40f9-8bec-b79a4c402eb5 tempest-VolumesActionsTest-1396530288 None] Terminate volume connection completed successfully. Sep 05 05:07:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8a7e3b22-e640-40f9-8bec-b79a4c402eb5 tempest-VolumesActionsTest-1396530288 None] Acquiring lock "cinder-99dc7a42-ef52-4f68-9703-3f31b1a99e71-detach_volume" by "detach_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8a7e3b22-e640-40f9-8bec-b79a4c402eb5 tempest-VolumesActionsTest-1396530288 None] Lock "cinder-99dc7a42-ef52-4f68-9703-3f31b1a99e71-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:54 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-8a7e3b22-e640-40f9-8bec-b79a4c402eb5 tempest-VolumesActionsTest-1396530288 None] Detaching volume 99dc7a42-ef52-4f68-9703-3f31b1a99e71 from instance 003ed9a0-e0e1-4da0-bb50-745dedf6dfc0. Sep 05 05:07:54 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-8a7e3b22-e640-40f9-8bec-b79a4c402eb5 tempest-VolumesActionsTest-1396530288 None] Detach volume completed successfully. Sep 05 05:07:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8a7e3b22-e640-40f9-8bec-b79a4c402eb5 tempest-VolumesActionsTest-1396530288 None] Lock "cinder-99dc7a42-ef52-4f68-9703-3f31b1a99e71-detach_volume" released by "detach_volume" :: held 0.114s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:55 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-cb167323-64cb-4a81-9439-5973c796aa41 tempest-VolumesActionsTest-818028394 None] Acquiring lock "cinder-99dc7a42-ef52-4f68-9703-3f31b1a99e71-detach_volume" by "detach_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:55 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-cb167323-64cb-4a81-9439-5973c796aa41 tempest-VolumesActionsTest-818028394 None] Lock "cinder-99dc7a42-ef52-4f68-9703-3f31b1a99e71-detach_volume" acquired by "detach_volume" :: waited 0.058s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:55 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-cb167323-64cb-4a81-9439-5973c796aa41 tempest-VolumesActionsTest-818028394 None] Volume detach called, but volume not attached. Sep 05 05:07:55 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-a1da3495-7f4c-4eb6-8af1-4ec413a4ce93 tempest-GroupsV320Test-766618150 None] Created reservations ['0ab53e02-c5b3-4616-bff4-181f29e365a4'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:07:55 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-cb167323-64cb-4a81-9439-5973c796aa41 tempest-VolumesActionsTest-818028394 None] Lock "cinder-99dc7a42-ef52-4f68-9703-3f31b1a99e71-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a1da3495-7f4c-4eb6-8af1-4ec413a4ce93 tempest-GroupsV320Test-766618150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a1da3495-7f4c-4eb6-8af1-4ec413a4ce93 tempest-GroupsV320Test-766618150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a1da3495-7f4c-4eb6-8af1-4ec413a4ce93 tempest-GroupsV320Test-766618150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:07:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a1da3495-7f4c-4eb6-8af1-4ec413a4ce93 tempest-GroupsV320Test-766618150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:07:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a1da3495-7f4c-4eb6-8af1-4ec413a4ce93 tempest-GroupsV320Test-766618150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a1da3495-7f4c-4eb6-8af1-4ec413a4ce93 tempest-GroupsV320Test-766618150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:55 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:07:55 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:55 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2fce19f6-3ebf-428c-b52e-8aa93db81117 tempest-VolumesActionsTest-818028394 None] Acquiring lock "cinder-99dc7a42-ef52-4f68-9703-3f31b1a99e71-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:55 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-7304a6d7-3e77-4a11-a929-6207866254da tempest-GroupSnapshotsTest-1729556448 None] Update group completed successfully. Sep 05 05:07:55 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2fce19f6-3ebf-428c-b52e-8aa93db81117 tempest-VolumesActionsTest-818028394 None] Lock "cinder-99dc7a42-ef52-4f68-9703-3f31b1a99e71-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:55 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a1da3495-7f4c-4eb6-8af1-4ec413a4ce93 tempest-GroupsV320Test-766618150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.434s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:55 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-a1da3495-7f4c-4eb6-8af1-4ec413a4ce93 tempest-GroupsV320Test-766618150 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:07:55 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2fce19f6-3ebf-428c-b52e-8aa93db81117 tempest-VolumesActionsTest-818028394 None] Acquiring lock "cinder-quobyte-99dc7a42-ef52-4f68-9703-3f31b1a99e71" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:07:55 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-a1da3495-7f4c-4eb6-8af1-4ec413a4ce93 tempest-GroupsV320Test-766618150 None] Delete group completed successfully. Sep 05 05:07:55 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2fce19f6-3ebf-428c-b52e-8aa93db81117 tempest-VolumesActionsTest-818028394 None] Lock "cinder-quobyte-99dc7a42-ef52-4f68-9703-3f31b1a99e71" acquired by "delete_volume" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:07:55 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfef733-7b25-427a-ac65-e772d8d65f2e]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:07:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2fce19f6-3ebf-428c-b52e-8aa93db81117 tempest-VolumesActionsTest-818028394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-99dc7a42-ef52-4f68-9703-3f31b1a99e71 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:56 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-99dc7a42-ef52-4f68-9703-3f31b1a99e71 Sep 05 05:07:56 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:56 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2fce19f6-3ebf-428c-b52e-8aa93db81117 tempest-VolumesActionsTest-818028394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-99dc7a42-ef52-4f68-9703-3f31b1a99e71" returned: 0 in 0.484s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2fce19f6-3ebf-428c-b52e-8aa93db81117 tempest-VolumesActionsTest-818028394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-99dc7a42-ef52-4f68-9703-3f31b1a99e71 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:56 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-99dc7a42-ef52-4f68-9703-3f31b1a99e71 Sep 05 05:07:56 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:56 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2fce19f6-3ebf-428c-b52e-8aa93db81117 tempest-VolumesActionsTest-818028394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-99dc7a42-ef52-4f68-9703-3f31b1a99e71" returned: 0 in 0.500s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2fce19f6-3ebf-428c-b52e-8aa93db81117 tempest-VolumesActionsTest-818028394 None] Lock "cinder-quobyte-99dc7a42-ef52-4f68-9703-3f31b1a99e71" released by "delete_volume" :: held 1.081s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:57 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-2fce19f6-3ebf-428c-b52e-8aa93db81117 tempest-VolumesActionsTest-818028394 None] Created reservations ['26857dde-0e08-4297-8c8f-52994a3a032b', '0e1e829f-6aa1-4c7b-9652-4261befe669e', 'e44ecf33-2b4d-419b-a3aa-7169c8178fdf', 'b8f2b9b7-462d-4291-b4f4-7ad8d2e9b3e3'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:07:57 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-26ed0602-d831-4d9d-b160-b0e692908c35 tempest-GroupSnapshotsTest-1729556448 None] Update group completed successfully. Sep 05 05:07:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2fce19f6-3ebf-428c-b52e-8aa93db81117 tempest-VolumesActionsTest-818028394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:07:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2fce19f6-3ebf-428c-b52e-8aa93db81117 tempest-VolumesActionsTest-818028394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:07:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2fce19f6-3ebf-428c-b52e-8aa93db81117 tempest-VolumesActionsTest-818028394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:07:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2fce19f6-3ebf-428c-b52e-8aa93db81117 tempest-VolumesActionsTest-818028394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:07:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2fce19f6-3ebf-428c-b52e-8aa93db81117 tempest-VolumesActionsTest-818028394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:07:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2fce19f6-3ebf-428c-b52e-8aa93db81117 tempest-VolumesActionsTest-818028394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:07:57 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:07:57 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:07:57 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Sep 05 05:07:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2fce19f6-3ebf-428c-b52e-8aa93db81117 tempest-VolumesActionsTest-818028394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.389s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:07:57 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-2fce19f6-3ebf-428c-b52e-8aa93db81117 tempest-VolumesActionsTest-818028394 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:07:57 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-2fce19f6-3ebf-428c-b52e-8aa93db81117 tempest-VolumesActionsTest-818028394 None] Deleted volume successfully. Sep 05 05:07:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2fce19f6-3ebf-428c-b52e-8aa93db81117 tempest-VolumesActionsTest-818028394 None] Lock "cinder-99dc7a42-ef52-4f68-9703-3f31b1a99e71-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:07:58 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-729de218-defe-4a61-8856-ccca1b5944b4 tempest-GroupSnapshotsTest-1729556448 None] Update group completed successfully. Sep 05 05:08:00 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-a10345ef-e355-4930-9dd1-3cfa3b04b157 tempest-GroupSnapshotsTest-1729556448 None] Update group completed successfully. Sep 05 05:08:01 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] GroupSnapshot 6afcaa33-b99d-4da7-ac69-5cc9cf327c8d: creating. Sep 05 05:08:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] Group snapshot 6afcaa33-b99d-4da7-ac69-5cc9cf327c8d: creating. {{(pid=89331) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 05 05:08:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] Creating offline snapshot 7998581a-5085-42b4-b2bd-244a4bfd9f43 of volume 6d0ec410-bc8f-482a-aa10-b46e6ff5078c {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:08:01 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf68b55-6de9-4645-808c-d09edead8d48]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:01 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c Sep 05 05:08:01 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:02 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c" returned: 0 in 0.517s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.7998581a-5085-42b4-b2bd-244a4bfd9f43 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:02 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.7998581a-5085-42b4-b2bd-244a4bfd9f43 1G Sep 05 05:08:02 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:02 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.7998581a-5085-42b4-b2bd-244a4bfd9f43 1G" returned: 0 in 0.593s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.7998581a-5085-42b4-b2bd-244a4bfd9f43 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:02 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.7998581a-5085-42b4-b2bd-244a4bfd9f43 Sep 05 05:08:02 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:03 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:08:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Flow 'volume_create_manager' (3f62a926-0aed-4893-9706-9aa6d6cca6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d07fa0-1995-44c9-b6f7-2ae8050f34f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d07fa0-1995-44c9-b6f7-2ae8050f34f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-171681418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80930effaa3b4b0fa26cc55d32c5292b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:03Z,use_quota=True,user_id='acac602cc4644dc98ca1bab773db38ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1a4006-20bd-4a67-bf61-355e92d1d332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1a4006-20bd-4a67-bf61-355e92d1d332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505e3013-6fe6-449f-a9d3-1c32e7718d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505e3013-6fe6-449f-a9d3-1c32e7718d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709', 'volume_name': 'volume-28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce1690c-539c-418d-acdd-af86b799379b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce1690c-539c-418d-acdd-af86b799379b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56628115-dc52-478e-ac68-5af420a7fce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:03 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Volume 28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709', 'volume_size': 1} Sep 05 05:08:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:03 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.7998581a-5085-42b4-b2bd-244a4bfd9f43" returned: 0 in 0.453s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:03 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.7998581a-5085-42b4-b2bd-244a4bfd9f43 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 05:08:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.7998581a-5085-42b4-b2bd-244a4bfd9f43 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:03 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.7998581a-5085-42b4-b2bd-244a4bfd9f43 Sep 05 05:08:03 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:03 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.7998581a-5085-42b4-b2bd-244a4bfd9f43" returned: 0 in 0.308s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:03 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.info Sep 05 05:08:03 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:04 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.info" returned: 0 in 0.424s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:04 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 05:08:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:04 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.info Sep 05 05:08:04 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:04 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.info" returned: 0 in 0.376s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.802s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] Creating offline snapshot bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9 of volume 7e6188c5-11ca-45e9-a05f-37ef16feb911 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:08:04 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66e1fa1-dd39-418b-8364-41ed30be86d4]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:04 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911 Sep 05 05:08:04 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:05 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911" returned: 0 in 0.433s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:05 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9 1G Sep 05 05:08:05 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:05 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9 1G" returned: 0 in 0.510s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e6188c5-11ca-45e9-a05f-37ef16feb911 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:05 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e6188c5-11ca-45e9-a05f-37ef16feb911 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9 Sep 05 05:08:05 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:05 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e6188c5-11ca-45e9-a05f-37ef16feb911 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9" returned: 0 in 0.369s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:05 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 05:08:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:05 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9 Sep 05 05:08:05 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:06 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9" returned: 0 in 0.306s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:06 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.info Sep 05 05:08:06 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:06 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.info" returned: 0 in 0.485s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:06 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 05:08:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:06 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.info Sep 05 05:08:06 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:07 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.info" returned: 0 in 0.563s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.825s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.202s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-171681418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80930effaa3b4b0fa26cc55d32c5292b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:03Z,use_quota=True,user_id='acac602cc4644dc98ca1bab773db38ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:08:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Creating volume 28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:08:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:08:07 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:08:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:07 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709 1073741824 Sep 05 05:08:07 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:07 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-9320a3ee-38eb-40cd-bcea-e0ae880a7974 tempest-GroupSnapshotsTest-1729556448 None] group_snapshot 6afcaa33-b99d-4da7-ac69-5cc9cf327c8d: created successfully Sep 05 05:08:08 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] group_snapshot 6afcaa33-b99d-4da7-ac69-5cc9cf327c8d: deleting Sep 05 05:08:08 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709 1073741824" returned: 0 in 0.999s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] group_snapshot 6afcaa33-b99d-4da7-ac69-5cc9cf327c8d: deleting {{(pid=89331) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 05 05:08:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "cinder-quobyte-6d0ec410-bc8f-482a-aa10-b46e6ff5078c" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-6d0ec410-bc8f-482a-aa10-b46e6ff5078c" acquired by "delete_snapshot" :: waited 0.040s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "cinder-quobyte-7998581a-5085-42b4-b2bd-244a4bfd9f43" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:08 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709 Sep 05 05:08:08 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-7998581a-5085-42b4-b2bd-244a4bfd9f43" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Deleting offline snapshot 7998581a-5085-42b4-b2bd-244a4bfd9f43 of volume 6d0ec410-bc8f-482a-aa10-b46e6ff5078c {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:08:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] snapshot_file for this snap is: volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.7998581a-5085-42b4-b2bd-244a4bfd9f43 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:08:08 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d546c685-1bbe-4b58-8103-1a4b2c9b7721]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.7998581a-5085-42b4-b2bd-244a4bfd9f43 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:08 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.7998581a-5085-42b4-b2bd-244a4bfd9f43 Sep 05 05:08:08 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709" returned: 0 in 0.361s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:08 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:08:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56628115-dc52-478e-ac68-5af420a7fce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa357f16-249d-4e6d-a83a-ec32e3619d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:08 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Volume volume-28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709 (28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709): created successfully Sep 05 05:08:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa357f16-249d-4e6d-a83a-ec32e3619d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Flow 'volume_create_manager' (3f62a926-0aed-4893-9706-9aa6d6cca6b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:08 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-5f9f9f64-a256-4ae7-a031-20ed2993dfa2 tempest-VolumesActionsTest-818028394 None] Created volume successfully. Sep 05 05:08:09 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.7998581a-5085-42b4-b2bd-244a4bfd9f43" returned: 0 in 0.486s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:08:09 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[1292ff5b-8dac-4733-9d08-f2bb26e31c37]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:09 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c Sep 05 05:08:09 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-23a41a48-184e-4816-817d-1e72570192b5 tempest-VolumesActionsTest-1396530288 None] Acquiring lock "cinder-28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:09 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c" returned: 0 in 0.622s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.7998581a-5085-42b4-b2bd-244a4bfd9f43 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-23a41a48-184e-4816-817d-1e72570192b5 tempest-VolumesActionsTest-1396530288 None] Lock "cinder-28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:09 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.7998581a-5085-42b4-b2bd-244a4bfd9f43 Sep 05 05:08:09 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-23a41a48-184e-4816-817d-1e72570192b5 tempest-VolumesActionsTest-1396530288 None] Acquiring lock "cinder-quobyte-28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-23a41a48-184e-4816-817d-1e72570192b5 tempest-VolumesActionsTest-1396530288 None] Lock "cinder-quobyte-28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709" acquired by "delete_volume" :: waited 0.036s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:09 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bca7cd-7431-4c12-b22a-8dc848cb781a]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-23a41a48-184e-4816-817d-1e72570192b5 tempest-VolumesActionsTest-1396530288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:10 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709 Sep 05 05:08:10 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:10 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.7998581a-5085-42b4-b2bd-244a4bfd9f43" returned: 0 in 0.575s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.7998581a-5085-42b4-b2bd-244a4bfd9f43 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:10 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.7998581a-5085-42b4-b2bd-244a4bfd9f43 Sep 05 05:08:10 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:10 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-23a41a48-184e-4816-817d-1e72570192b5 tempest-VolumesActionsTest-1396530288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709" returned: 0 in 0.802s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-23a41a48-184e-4816-817d-1e72570192b5 tempest-VolumesActionsTest-1396530288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:10 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c.7998581a-5085-42b4-b2bd-244a4bfd9f43" returned: 0 in 0.494s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:10 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709 Sep 05 05:08:10 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-7998581a-5085-42b4-b2bd-244a4bfd9f43" released by "_delete_snapshot" :: held 2.357s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-6d0ec410-bc8f-482a-aa10-b46e6ff5078c" released by "delete_snapshot" :: held 2.401s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "cinder-quobyte-7e6188c5-11ca-45e9-a05f-37ef16feb911" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-7e6188c5-11ca-45e9-a05f-37ef16feb911" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "cinder-quobyte-bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Deleting offline snapshot bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9 of volume 7e6188c5-11ca-45e9-a05f-37ef16feb911 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:08:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] snapshot_file for this snap is: volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:08:11 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7899159a-c56d-40a1-852c-d9794a958c3f]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:11 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-23a41a48-184e-4816-817d-1e72570192b5 tempest-VolumesActionsTest-1396530288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709" returned: 0 in 0.437s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-23a41a48-184e-4816-817d-1e72570192b5 tempest-VolumesActionsTest-1396530288 None] Lock "cinder-quobyte-28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709" released by "delete_volume" :: held 1.319s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:11 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9 Sep 05 05:08:11 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:11 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-23a41a48-184e-4816-817d-1e72570192b5 tempest-VolumesActionsTest-1396530288 None] Created reservations ['d858c66a-df26-401a-9286-e5094111d689', 'd3e6c62c-75ec-496e-8bf1-bbbc7b1dffb5', 'f54e1b69-4f5c-4009-b7ef-53dc4e99551d', '503e7f5d-7030-4e70-a7de-5c2bfcd5a8df'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:08:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-23a41a48-184e-4816-817d-1e72570192b5 tempest-VolumesActionsTest-1396530288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-23a41a48-184e-4816-817d-1e72570192b5 tempest-VolumesActionsTest-1396530288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-23a41a48-184e-4816-817d-1e72570192b5 tempest-VolumesActionsTest-1396530288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-23a41a48-184e-4816-817d-1e72570192b5 tempest-VolumesActionsTest-1396530288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-23a41a48-184e-4816-817d-1e72570192b5 tempest-VolumesActionsTest-1396530288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-23a41a48-184e-4816-817d-1e72570192b5 tempest-VolumesActionsTest-1396530288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:11 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:08:11 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:11 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9" returned: 0 in 0.465s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e6188c5-11ca-45e9-a05f-37ef16feb911(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:08:11 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6f1619-1d8b-42d7-b4cf-47b914f01c5f]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:11 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-23a41a48-184e-4816-817d-1e72570192b5 tempest-VolumesActionsTest-1396530288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.322s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:11 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-23a41a48-184e-4816-817d-1e72570192b5 tempest-VolumesActionsTest-1396530288 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:08:11 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-23a41a48-184e-4816-817d-1e72570192b5 tempest-VolumesActionsTest-1396530288 None] Deleted volume successfully. Sep 05 05:08:11 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911 Sep 05 05:08:11 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-23a41a48-184e-4816-817d-1e72570192b5 tempest-VolumesActionsTest-1396530288 None] Lock "cinder-28ecd8e8-ee2e-4e04-8a2b-fb35b4ce1709-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:12 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911" returned: 0 in 0.652s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:12 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9 Sep 05 05:08:12 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:12 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9" returned: 0 in 0.753s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:13 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9 Sep 05 05:08:13 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Flow 'volume_create_manager' (f15f0376-be9c-4fc0-9332-24787141cbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9680eab-367a-44a6-8f7e-8038df57b0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9680eab-367a-44a6-8f7e-8038df57b0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-60525158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4190d39d-8164-46b9-bf02-35ed40a3ea52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80930effaa3b4b0fa26cc55d32c5292b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:13Z,use_quota=True,user_id='acac602cc4644dc98ca1bab773db38ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3085c869-7811-4ca2-8350-ee16be22a5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3085c869-7811-4ca2-8350-ee16be22a5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e4b1197-a2e5-41e4-86f7-a08469943e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:13 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e4b1197-a2e5-41e4-86f7-a08469943e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4190d39d-8164-46b9-bf02-35ed40a3ea52', 'volume_name': 'volume-4190d39d-8164-46b9-bf02-35ed40a3ea52', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302658d5-a52f-4d86-a8a1-268ee75f9cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302658d5-a52f-4d86-a8a1-268ee75f9cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5edcf216-4356-40bb-ac94-af8766718f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:13 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Volume 4190d39d-8164-46b9-bf02-35ed40a3ea52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4190d39d-8164-46b9-bf02-35ed40a3ea52', 'volume_size': 1} Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-60525158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4190d39d-8164-46b9-bf02-35ed40a3ea52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80930effaa3b4b0fa26cc55d32c5292b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:13Z,use_quota=True,user_id='acac602cc4644dc98ca1bab773db38ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Creating volume 4190d39d-8164-46b9-bf02-35ed40a3ea52 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:08:13 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4190d39d-8164-46b9-bf02-35ed40a3ea52 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911.bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9" returned: 0 in 0.579s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:13 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4190d39d-8164-46b9-bf02-35ed40a3ea52 1073741824 Sep 05 05:08:13 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-bdc3fca0-85ad-44ea-a454-d3f6b0c4efd9" released by "_delete_snapshot" :: held 2.653s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-7e6188c5-11ca-45e9-a05f-37ef16feb911" released by "delete_snapshot" :: held 2.709s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:13 devstack cinder-volume[89331]: WARNING cinder.quota [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-692841520 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-692841520, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:08:13 devstack cinder-volume[89331]: WARNING cinder.quota [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-692841520 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-692841520, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:08:13 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Created reservations ['1bde8029-5d11-4c53-a310-00c1a652e6ea', 'd822f87c-b41a-46d2-9f11-975da0082569', 'ffea8c66-c0a8-4334-bffa-38769bddb0ca', 'ab9d0cea-2e32-49fa-b470-b75b6a1b208d'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:08:14 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4190d39d-8164-46b9-bf02-35ed40a3ea52 1073741824" returned: 0 in 0.688s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:14 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] Created reservations ['a8934015-eaab-43e3-a024-5b27e1e62523', '3bf8c301-521c-4fd8-a836-ac8488ffa098', 'de1fc5fe-5cc6-4606-8dd8-947a59bc37d3', 'dd9b7158-5cf4-4300-9309-32a9561dd3b4'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:08:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4190d39d-8164-46b9-bf02-35ed40a3ea52 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:14 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4190d39d-8164-46b9-bf02-35ed40a3ea52 Sep 05 05:08:14 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:14 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-d8a07543-07e6-416e-82df-299d246b1c7a tempest-GroupSnapshotsTest-1729556448 None] group_snapshot 6afcaa33-b99d-4da7-ac69-5cc9cf327c8d: deleted successfully Sep 05 05:08:14 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4190d39d-8164-46b9-bf02-35ed40a3ea52" returned: 0 in 0.363s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:14 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:08:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:14 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5edcf216-4356-40bb-ac94-af8766718f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4190d39d-8164-46b9-bf02-35ed40a3ea52', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:14 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91b6599-0e88-402e-8919-b22e9b1dcd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:14 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Volume volume-4190d39d-8164-46b9-bf02-35ed40a3ea52 (4190d39d-8164-46b9-bf02-35ed40a3ea52): created successfully Sep 05 05:08:14 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91b6599-0e88-402e-8919-b22e9b1dcd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:14 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Flow 'volume_create_manager' (f15f0376-be9c-4fc0-9332-24787141cbc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:14 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-1befe425-bbef-46f1-a0ac-33850d00957f tempest-VolumesActionsTest-818028394 None] Created volume successfully. Sep 05 05:08:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a31b4b87-feb4-4dc9-ad5b-72151b14ace3 tempest-VolumesActionsTest-1396530288 None] Acquiring lock "cinder-4190d39d-8164-46b9-bf02-35ed40a3ea52-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a31b4b87-feb4-4dc9-ad5b-72151b14ace3 tempest-VolumesActionsTest-1396530288 None] Lock "cinder-4190d39d-8164-46b9-bf02-35ed40a3ea52-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a31b4b87-feb4-4dc9-ad5b-72151b14ace3 tempest-VolumesActionsTest-1396530288 None] Acquiring lock "cinder-quobyte-4190d39d-8164-46b9-bf02-35ed40a3ea52" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a31b4b87-feb4-4dc9-ad5b-72151b14ace3 tempest-VolumesActionsTest-1396530288 None] Lock "cinder-quobyte-4190d39d-8164-46b9-bf02-35ed40a3ea52" acquired by "delete_volume" :: waited 0.064s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:15 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d815eb0f-8d17-40ff-8696-0aecf17fb68f]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a31b4b87-feb4-4dc9-ad5b-72151b14ace3 tempest-VolumesActionsTest-1396530288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4190d39d-8164-46b9-bf02-35ed40a3ea52 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:15 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4190d39d-8164-46b9-bf02-35ed40a3ea52 Sep 05 05:08:15 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "cinder-quobyte-6d0ec410-bc8f-482a-aa10-b46e6ff5078c" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-6d0ec410-bc8f-482a-aa10-b46e6ff5078c" acquired by "delete_volume" :: waited 0.052s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:16 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c409935-8690-4466-89b6-96b3941ce195]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:16 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a31b4b87-feb4-4dc9-ad5b-72151b14ace3 tempest-VolumesActionsTest-1396530288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4190d39d-8164-46b9-bf02-35ed40a3ea52" returned: 0 in 0.757s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a31b4b87-feb4-4dc9-ad5b-72151b14ace3 tempest-VolumesActionsTest-1396530288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4190d39d-8164-46b9-bf02-35ed40a3ea52 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:16 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c Sep 05 05:08:16 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:16 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4190d39d-8164-46b9-bf02-35ed40a3ea52 Sep 05 05:08:16 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:16 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a31b4b87-feb4-4dc9-ad5b-72151b14ace3 tempest-VolumesActionsTest-1396530288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4190d39d-8164-46b9-bf02-35ed40a3ea52" returned: 0 in 0.428s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a31b4b87-feb4-4dc9-ad5b-72151b14ace3 tempest-VolumesActionsTest-1396530288 None] Lock "cinder-quobyte-4190d39d-8164-46b9-bf02-35ed40a3ea52" released by "delete_volume" :: held 1.281s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:16 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c" returned: 0 in 0.831s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:17 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-a31b4b87-feb4-4dc9-ad5b-72151b14ace3 tempest-VolumesActionsTest-1396530288 None] Created reservations ['71c27745-d501-4777-983b-83f41d969f17', '15732b1a-ccf3-4aed-9a62-b0f91d9f8f05', '1f145be3-26c2-487c-9568-6151958453c9', '8b958adc-fdbf-4c35-939d-7234985c130e'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:08:17 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c Sep 05 05:08:17 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a31b4b87-feb4-4dc9-ad5b-72151b14ace3 tempest-VolumesActionsTest-1396530288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a31b4b87-feb4-4dc9-ad5b-72151b14ace3 tempest-VolumesActionsTest-1396530288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a31b4b87-feb4-4dc9-ad5b-72151b14ace3 tempest-VolumesActionsTest-1396530288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a31b4b87-feb4-4dc9-ad5b-72151b14ace3 tempest-VolumesActionsTest-1396530288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a31b4b87-feb4-4dc9-ad5b-72151b14ace3 tempest-VolumesActionsTest-1396530288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a31b4b87-feb4-4dc9-ad5b-72151b14ace3 tempest-VolumesActionsTest-1396530288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:17 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:08:17 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:17 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d0ec410-bc8f-482a-aa10-b46e6ff5078c" returned: 0 in 0.318s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:17 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-6d0ec410-bc8f-482a-aa10-b46e6ff5078c" released by "delete_volume" :: held 1.272s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:17 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "cinder-quobyte-7e6188c5-11ca-45e9-a05f-37ef16feb911" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:17 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-7e6188c5-11ca-45e9-a05f-37ef16feb911" acquired by "delete_volume" :: waited 0.028s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:17 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c81511-8600-4d97-9c46-78d8c83f9675]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:17 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911 Sep 05 05:08:17 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:17 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a31b4b87-feb4-4dc9-ad5b-72151b14ace3 tempest-VolumesActionsTest-1396530288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.497s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:17 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-a31b4b87-feb4-4dc9-ad5b-72151b14ace3 tempest-VolumesActionsTest-1396530288 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:08:17 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-a31b4b87-feb4-4dc9-ad5b-72151b14ace3 tempest-VolumesActionsTest-1396530288 None] Deleted volume successfully. Sep 05 05:08:17 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a31b4b87-feb4-4dc9-ad5b-72151b14ace3 tempest-VolumesActionsTest-1396530288 None] Lock "cinder-4190d39d-8164-46b9-bf02-35ed40a3ea52-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:18 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911" returned: 0 in 0.867s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:18 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911 Sep 05 05:08:18 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:19 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7e6188c5-11ca-45e9-a05f-37ef16feb911" returned: 0 in 0.957s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-7e6188c5-11ca-45e9-a05f-37ef16feb911" released by "delete_volume" :: held 1.964s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] Created reservations ['cbd63160-7a5f-4ead-bb3c-9168c54b57a0'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:08:19 devstack cinder-volume[89331]: WARNING cinder.quota [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-692841520 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-692841520, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] Created reservations ['9b6b7b41-a802-443c-85e1-2b47e22cde78', '30c3960f-e480-421f-9db6-8964b87fe4bf', 'b9106c59-72cb-4a8a-b9ac-f957379eaeda', 'c194f349-0560-4230-bd94-94cd0eca14e6'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Flow 'volume_create_manager' (8bed087e-ad20-40fe-8867-6627f3c5d387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb66a182-b8c5-4e92-80b5-f84a2650bdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb66a182-b8c5-4e92-80b5-f84a2650bdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1688451573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3306366-795e-405d-924b-e2dcd3c4f415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80930effaa3b4b0fa26cc55d32c5292b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:20Z,use_quota=True,user_id='acac602cc4644dc98ca1bab773db38ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d52d3d5-4023-4d5f-95ba-713cd92321b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d52d3d5-4023-4d5f-95ba-713cd92321b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7809adc2-cec0-4014-8799-12fec47ba0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7809adc2-cec0-4014-8799-12fec47ba0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3306366-795e-405d-924b-e2dcd3c4f415', 'volume_name': 'volume-f3306366-795e-405d-924b-e2dcd3c4f415', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8660ee58-abc9-454f-8d8b-72147e0c27df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8660ee58-abc9-454f-8d8b-72147e0c27df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62539dda-a2e4-41e3-a58e-232610b6c116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:19 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Volume f3306366-795e-405d-924b-e2dcd3c4f415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3306366-795e-405d-924b-e2dcd3c4f415', 'volume_size': 1} Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1688451573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3306366-795e-405d-924b-e2dcd3c4f415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80930effaa3b4b0fa26cc55d32c5292b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:20Z,use_quota=True,user_id='acac602cc4644dc98ca1bab773db38ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Creating volume f3306366-795e-405d-924b-e2dcd3c4f415 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:08:19 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:08:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f3306366-795e-405d-924b-e2dcd3c4f415 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:19 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f3306366-795e-405d-924b-e2dcd3c4f415 1073741824 Sep 05 05:08:19 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:20 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] Created reservations ['cc5edfe7-3221-4a2e-82f7-5252f924ee5c', 'e8a2e5e9-3324-406c-87e5-44f51ad73d6b', 'b2f31c9c-d514-4ec2-9847-23140cbe5be3', '1e16eb51-6a06-48f9-af75-e2949aa7a1ff'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:08:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:20 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:08:20 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:21 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f3306366-795e-405d-924b-e2dcd3c4f415 1073741824" returned: 0 in 1.200s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f3306366-795e-405d-924b-e2dcd3c4f415 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:21 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f3306366-795e-405d-924b-e2dcd3c4f415 Sep 05 05:08:21 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:21 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.715s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:21 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:08:21 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-218f8965-57fd-44da-964b-dfa4849bcb33 tempest-GroupSnapshotsTest-1729556448 None] Delete group completed successfully. Sep 05 05:08:21 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f3306366-795e-405d-924b-e2dcd3c4f415" returned: 0 in 0.461s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:08:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62539dda-a2e4-41e3-a58e-232610b6c116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3306366-795e-405d-924b-e2dcd3c4f415', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b054d9d-c5d2-4083-a9f7-df13458ee486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:21 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Volume volume-f3306366-795e-405d-924b-e2dcd3c4f415 (f3306366-795e-405d-924b-e2dcd3c4f415): created successfully Sep 05 05:08:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b054d9d-c5d2-4083-a9f7-df13458ee486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Flow 'volume_create_manager' (8bed087e-ad20-40fe-8867-6627f3c5d387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:21 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-f450b199-769e-4cbb-83f8-4d75aca977ae tempest-VolumesActionsTest-818028394 None] Created volume successfully. Sep 05 05:08:22 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-0d0739ad-1731-4580-8f41-07a354595537 tempest-GroupSnapshotsTest-1729556448 None] Group tempest-GroupSnapshotsTest-Group-706394675: creating Sep 05 05:08:22 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-0d0739ad-1731-4580-8f41-07a354595537 tempest-GroupSnapshotsTest-1729556448 None] Group tempest-GroupSnapshotsTest-Group-706394675: created successfully Sep 05 05:08:22 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-0d0739ad-1731-4580-8f41-07a354595537 tempest-GroupSnapshotsTest-1729556448 None] Create group completed successfully. Sep 05 05:08:22 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d9de38f7-f03e-4d46-89ed-fb581089d65a tempest-VolumesActionsTest-1396530288 None] Acquiring lock "cinder-f3306366-795e-405d-924b-e2dcd3c4f415-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:22 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d9de38f7-f03e-4d46-89ed-fb581089d65a tempest-VolumesActionsTest-1396530288 None] Lock "cinder-f3306366-795e-405d-924b-e2dcd3c4f415-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:22 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d9de38f7-f03e-4d46-89ed-fb581089d65a tempest-VolumesActionsTest-1396530288 None] Acquiring lock "cinder-quobyte-f3306366-795e-405d-924b-e2dcd3c4f415" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:22 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d9de38f7-f03e-4d46-89ed-fb581089d65a tempest-VolumesActionsTest-1396530288 None] Lock "cinder-quobyte-f3306366-795e-405d-924b-e2dcd3c4f415" acquired by "delete_volume" :: waited 0.035s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:23 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b4997b-e409-43f0-be2c-a35e5465e737]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d9de38f7-f03e-4d46-89ed-fb581089d65a tempest-VolumesActionsTest-1396530288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f3306366-795e-405d-924b-e2dcd3c4f415 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:23 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f3306366-795e-405d-924b-e2dcd3c4f415 Sep 05 05:08:23 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:23 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d9de38f7-f03e-4d46-89ed-fb581089d65a tempest-VolumesActionsTest-1396530288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f3306366-795e-405d-924b-e2dcd3c4f415" returned: 0 in 0.636s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d9de38f7-f03e-4d46-89ed-fb581089d65a tempest-VolumesActionsTest-1396530288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f3306366-795e-405d-924b-e2dcd3c4f415 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:23 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f3306366-795e-405d-924b-e2dcd3c4f415 Sep 05 05:08:23 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:24 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d9de38f7-f03e-4d46-89ed-fb581089d65a tempest-VolumesActionsTest-1396530288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f3306366-795e-405d-924b-e2dcd3c4f415" returned: 0 in 0.514s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d9de38f7-f03e-4d46-89ed-fb581089d65a tempest-VolumesActionsTest-1396530288 None] Lock "cinder-quobyte-f3306366-795e-405d-924b-e2dcd3c4f415" released by "delete_volume" :: held 1.274s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Flow 'volume_create_manager' (8114154c-1a85-4768-9e16-e6ae038ef1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a55f480a-d275-4c3b-9a31-5bdd043fc347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a55f480a-d275-4c3b-9a31-5bdd043fc347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-233922180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f16e23e7-ee16-4456-943f-7484ef09c2f8,host='devstack@QuobyteHD#QuobyteHD',id=725c3821-5dca-4ee8-993c-fcaf69178e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e7c3bc65d5437086628b49624199d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:24Z,use_quota=True,user_id='aecb10d760de47aab00d0cc7fc05dd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4326f45-8a63-422d-92e2-0c4c6948f71c),volume_type_id=f4326f45-8a63-422d-92e2-0c4c6948f71c)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae01ab6-8cd9-4e14-955d-0e0e9a3c6a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae01ab6-8cd9-4e14-955d-0e0e9a3c6a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f9ca145-af9a-4771-bff5-c02c84b694dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f9ca145-af9a-4771-bff5-c02c84b694dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '725c3821-5dca-4ee8-993c-fcaf69178e9b', 'volume_name': 'volume-725c3821-5dca-4ee8-993c-fcaf69178e9b', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fffa54ab-51e0-4205-8808-54e3a4bcf1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fffa54ab-51e0-4205-8808-54e3a4bcf1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058aa1b1-a7bb-4917-b324-06ed1d73587e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:24 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Volume 725c3821-5dca-4ee8-993c-fcaf69178e9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-725c3821-5dca-4ee8-993c-fcaf69178e9b', 'volume_size': 1} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f16e23e7-ee16-4456-943f-7484ef09c2f8,created_at=2026-09-05T03:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-233922180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f16e23e7-ee16-4456-943f-7484ef09c2f8,host='devstack@QuobyteHD#QuobyteHD',id=725c3821-5dca-4ee8-993c-fcaf69178e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e7c3bc65d5437086628b49624199d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:24Z,use_quota=True,user_id='aecb10d760de47aab00d0cc7fc05dd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4326f45-8a63-422d-92e2-0c4c6948f71c),volume_type_id=f4326f45-8a63-422d-92e2-0c4c6948f71c)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Creating volume 725c3821-5dca-4ee8-993c-fcaf69178e9b {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:08:24 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:24 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b 1073741824 Sep 05 05:08:24 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-d9de38f7-f03e-4d46-89ed-fb581089d65a tempest-VolumesActionsTest-1396530288 None] Created reservations ['1f5a9b10-71aa-4d49-962d-e407791ff312', 'b3318e08-15bc-49cb-b44f-06fce1224aa0', '9f5018eb-4f1f-4f42-9cdc-f671933e47c0', '9d366335-db38-41b6-b466-ddca0c785f12'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d9de38f7-f03e-4d46-89ed-fb581089d65a tempest-VolumesActionsTest-1396530288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d9de38f7-f03e-4d46-89ed-fb581089d65a tempest-VolumesActionsTest-1396530288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d9de38f7-f03e-4d46-89ed-fb581089d65a tempest-VolumesActionsTest-1396530288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d9de38f7-f03e-4d46-89ed-fb581089d65a tempest-VolumesActionsTest-1396530288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d9de38f7-f03e-4d46-89ed-fb581089d65a tempest-VolumesActionsTest-1396530288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d9de38f7-f03e-4d46-89ed-fb581089d65a tempest-VolumesActionsTest-1396530288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:24 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:08:24 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:25 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d9de38f7-f03e-4d46-89ed-fb581089d65a tempest-VolumesActionsTest-1396530288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.422s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-d9de38f7-f03e-4d46-89ed-fb581089d65a tempest-VolumesActionsTest-1396530288 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:08:25 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-d9de38f7-f03e-4d46-89ed-fb581089d65a tempest-VolumesActionsTest-1396530288 None] Deleted volume successfully. Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d9de38f7-f03e-4d46-89ed-fb581089d65a tempest-VolumesActionsTest-1396530288 None] Lock "cinder-f3306366-795e-405d-924b-e2dcd3c4f415-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:25 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b 1073741824" returned: 0 in 0.761s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:25 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b Sep 05 05:08:25 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:25 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b" returned: 0 in 0.303s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058aa1b1-a7bb-4917-b324-06ed1d73587e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-725c3821-5dca-4ee8-993c-fcaf69178e9b', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d59e0dab-07ca-4299-a919-03c9c727226a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:25 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Volume volume-725c3821-5dca-4ee8-993c-fcaf69178e9b (725c3821-5dca-4ee8-993c-fcaf69178e9b): created successfully Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d59e0dab-07ca-4299-a919-03c9c727226a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Flow 'volume_create_manager' (8114154c-1a85-4768-9e16-e6ae038ef1d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:25 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-0baab538-4489-42c4-b291-9a75c22043db tempest-GroupSnapshotsTest-1729556448 None] Created volume successfully. Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Flow 'volume_create_manager' (32e3b1cb-4a26-4948-a472-13195d1a920a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95d13d5-c60d-4567-aa8a-7a2edc589729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95d13d5-c60d-4567-aa8a-7a2edc589729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2003728567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f23f25-016d-496d-a870-7d6138477cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80930effaa3b4b0fa26cc55d32c5292b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:26Z,use_quota=True,user_id='acac602cc4644dc98ca1bab773db38ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cde928-3f39-4509-96c0-87772a34a6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cde928-3f39-4509-96c0-87772a34a6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e2eddef-d08c-4469-884e-3a608bd22e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e2eddef-d08c-4469-884e-3a608bd22e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80f23f25-016d-496d-a870-7d6138477cfe', 'volume_name': 'volume-80f23f25-016d-496d-a870-7d6138477cfe', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1053d7e-97ba-4482-823b-a811f0c4aca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1053d7e-97ba-4482-823b-a811f0c4aca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e608ff80-62bc-429a-b3b8-3b0e01c31141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:25 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Volume 80f23f25-016d-496d-a870-7d6138477cfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80f23f25-016d-496d-a870-7d6138477cfe', 'volume_size': 1} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2003728567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f23f25-016d-496d-a870-7d6138477cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80930effaa3b4b0fa26cc55d32c5292b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:26Z,use_quota=True,user_id='acac602cc4644dc98ca1bab773db38ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Creating volume 80f23f25-016d-496d-a870-7d6138477cfe {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:08:25 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:08:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-80f23f25-016d-496d-a870-7d6138477cfe 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:26 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-80f23f25-016d-496d-a870-7d6138477cfe 1073741824 Sep 05 05:08:26 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:26 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-80f23f25-016d-496d-a870-7d6138477cfe 1073741824" returned: 0 in 0.487s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-80f23f25-016d-496d-a870-7d6138477cfe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:26 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-80f23f25-016d-496d-a870-7d6138477cfe Sep 05 05:08:26 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:08:26 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Flow 'volume_create_manager' (88cf4530-3ddb-4113-a31b-fe106a578b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbc99f5-6ec9-4cfe-9e7a-9eb2203988f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-80f23f25-016d-496d-a870-7d6138477cfe" returned: 0 in 0.349s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbc99f5-6ec9-4cfe-9e7a-9eb2203988f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-91471262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23473ff4-e264-453f-90f4-b5fcca4e1d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ce7ba0ba31e4aae9795f97aa9676155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:27Z,use_quota=True,user_id='d428d5b97c2a48eb9a06b06d1785a486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b91a890-88ba-409c-a437-e5e449de3d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b91a890-88ba-409c-a437-e5e449de3d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ad5afc-e2d3-4fb5-8b9c-90f42051949c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ad5afc-e2d3-4fb5-8b9c-90f42051949c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23473ff4-e264-453f-90f4-b5fcca4e1d68', 'volume_name': 'volume-23473ff4-e264-453f-90f4-b5fcca4e1d68', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee527c5-9db3-495a-85cd-9aece3ccd4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee527c5-9db3-495a-85cd-9aece3ccd4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc73b07-edf9-4fab-a2dc-9a72128256b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:26 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Volume 23473ff4-e264-453f-90f4-b5fcca4e1d68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23473ff4-e264-453f-90f4-b5fcca4e1d68', 'volume_size': 1} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-91471262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23473ff4-e264-453f-90f4-b5fcca4e1d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ce7ba0ba31e4aae9795f97aa9676155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:27Z,use_quota=True,user_id='d428d5b97c2a48eb9a06b06d1785a486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Creating volume 23473ff4-e264-453f-90f4-b5fcca4e1d68 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:08:26 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23473ff4-e264-453f-90f4-b5fcca4e1d68 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e608ff80-62bc-429a-b3b8-3b0e01c31141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80f23f25-016d-496d-a870-7d6138477cfe', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:26 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23473ff4-e264-453f-90f4-b5fcca4e1d68 1073741824 Sep 05 05:08:26 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2385d435-9a6b-4e47-b017-ed85616dd169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:27 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Volume volume-80f23f25-016d-496d-a870-7d6138477cfe (80f23f25-016d-496d-a870-7d6138477cfe): created successfully Sep 05 05:08:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2385d435-9a6b-4e47-b017-ed85616dd169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Flow 'volume_create_manager' (32e3b1cb-4a26-4948-a472-13195d1a920a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:27 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-050f1117-7a59-4ecf-bb72-da003e12678d tempest-VolumesActionsTest-818028394 None] Created volume successfully. Sep 05 05:08:27 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-1827e407-4f12-425e-8f68-8543ed360708 tempest-GroupSnapshotsTest-1729556448 None] GroupSnapshot 2d34439b-e561-4aa1-975c-1792a512c894: creating. Sep 05 05:08:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1827e407-4f12-425e-8f68-8543ed360708 tempest-GroupSnapshotsTest-1729556448 None] Group snapshot 2d34439b-e561-4aa1-975c-1792a512c894: creating. {{(pid=89331) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 05 05:08:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1827e407-4f12-425e-8f68-8543ed360708 tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:27 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23473ff4-e264-453f-90f4-b5fcca4e1d68 1073741824" returned: 0 in 0.581s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23473ff4-e264-453f-90f4-b5fcca4e1d68 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:27 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23473ff4-e264-453f-90f4-b5fcca4e1d68 Sep 05 05:08:27 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:27 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23473ff4-e264-453f-90f4-b5fcca4e1d68" returned: 0 in 0.269s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:08:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1827e407-4f12-425e-8f68-8543ed360708 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.618s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc73b07-edf9-4fab-a2dc-9a72128256b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23473ff4-e264-453f-90f4-b5fcca4e1d68', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad88934-2f11-42d9-8cfb-114e6252ab5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-1827e407-4f12-425e-8f68-8543ed360708 tempest-GroupSnapshotsTest-1729556448 None] Creating offline snapshot 0c20d2bc-10f3-4374-9497-458fc0bc9175 of volume 725c3821-5dca-4ee8-993c-fcaf69178e9b {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:08:27 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Volume volume-23473ff4-e264-453f-90f4-b5fcca4e1d68 (23473ff4-e264-453f-90f4-b5fcca4e1d68): created successfully Sep 05 05:08:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad88934-2f11-42d9-8cfb-114e6252ab5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Flow 'volume_create_manager' (88cf4530-3ddb-4113-a31b-fe106a578b42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:27 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c10e1ff-943d-4893-aec4-97d57ead8ef7]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1827e407-4f12-425e-8f68-8543ed360708 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:27 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-6744035e-030a-4096-903d-3bc95d290e26 tempest-ServersNegativeTestJSON-1677716532 None] Created volume successfully. Sep 05 05:08:28 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b Sep 05 05:08:28 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2f70f0a-56f0-4456-9296-b79991db7b8f tempest-VolumesActionsTest-1396530288 None] Acquiring lock "cinder-80f23f25-016d-496d-a870-7d6138477cfe-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2f70f0a-56f0-4456-9296-b79991db7b8f tempest-VolumesActionsTest-1396530288 None] Lock "cinder-80f23f25-016d-496d-a870-7d6138477cfe-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2f70f0a-56f0-4456-9296-b79991db7b8f tempest-VolumesActionsTest-1396530288 None] Acquiring lock "cinder-quobyte-80f23f25-016d-496d-a870-7d6138477cfe" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2f70f0a-56f0-4456-9296-b79991db7b8f tempest-VolumesActionsTest-1396530288 None] Lock "cinder-quobyte-80f23f25-016d-496d-a870-7d6138477cfe" acquired by "delete_volume" :: waited 0.023s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:28 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fba963-c52c-4c16-82e8-78d3a2c60b27]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2f70f0a-56f0-4456-9296-b79991db7b8f tempest-VolumesActionsTest-1396530288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-80f23f25-016d-496d-a870-7d6138477cfe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:28 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1827e407-4f12-425e-8f68-8543ed360708 tempest-GroupSnapshotsTest-1729556448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b" returned: 0 in 0.572s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1827e407-4f12-425e-8f68-8543ed360708 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.0c20d2bc-10f3-4374-9497-458fc0bc9175 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:28 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.0c20d2bc-10f3-4374-9497-458fc0bc9175 1G Sep 05 05:08:28 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:28 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-80f23f25-016d-496d-a870-7d6138477cfe Sep 05 05:08:28 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:28 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2f70f0a-56f0-4456-9296-b79991db7b8f tempest-VolumesActionsTest-1396530288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-80f23f25-016d-496d-a870-7d6138477cfe" returned: 0 in 0.492s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2f70f0a-56f0-4456-9296-b79991db7b8f tempest-VolumesActionsTest-1396530288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-80f23f25-016d-496d-a870-7d6138477cfe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:28 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-80f23f25-016d-496d-a870-7d6138477cfe Sep 05 05:08:28 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:28 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1827e407-4f12-425e-8f68-8543ed360708 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.0c20d2bc-10f3-4374-9497-458fc0bc9175 1G" returned: 0 in 0.489s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1827e407-4f12-425e-8f68-8543ed360708 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-725c3821-5dca-4ee8-993c-fcaf69178e9b -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.0c20d2bc-10f3-4374-9497-458fc0bc9175 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:29 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-725c3821-5dca-4ee8-993c-fcaf69178e9b -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.0c20d2bc-10f3-4374-9497-458fc0bc9175 Sep 05 05:08:29 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:29 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2f70f0a-56f0-4456-9296-b79991db7b8f tempest-VolumesActionsTest-1396530288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-80f23f25-016d-496d-a870-7d6138477cfe" returned: 0 in 0.404s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2f70f0a-56f0-4456-9296-b79991db7b8f tempest-VolumesActionsTest-1396530288 None] Lock "cinder-quobyte-80f23f25-016d-496d-a870-7d6138477cfe" released by "delete_volume" :: held 0.975s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:29 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-b2f70f0a-56f0-4456-9296-b79991db7b8f tempest-VolumesActionsTest-1396530288 None] Created reservations ['2b4b0965-f73a-4fb0-8538-77810b6e5609', 'e8579be8-f82d-4a0b-a3a4-5c90eee58e14', '438d9dc1-208f-464f-81c3-9fee853e0e57', '0a4bae0d-b249-429b-bf9e-15a554e8f193'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:08:29 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1827e407-4f12-425e-8f68-8543ed360708 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-725c3821-5dca-4ee8-993c-fcaf69178e9b -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.0c20d2bc-10f3-4374-9497-458fc0bc9175" returned: 0 in 0.525s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:29 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-1827e407-4f12-425e-8f68-8543ed360708 tempest-GroupSnapshotsTest-1729556448 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.0c20d2bc-10f3-4374-9497-458fc0bc9175 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 05:08:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1827e407-4f12-425e-8f68-8543ed360708 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.0c20d2bc-10f3-4374-9497-458fc0bc9175 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:29 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.0c20d2bc-10f3-4374-9497-458fc0bc9175 Sep 05 05:08:29 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b2f70f0a-56f0-4456-9296-b79991db7b8f tempest-VolumesActionsTest-1396530288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b2f70f0a-56f0-4456-9296-b79991db7b8f tempest-VolumesActionsTest-1396530288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:29 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b2f70f0a-56f0-4456-9296-b79991db7b8f tempest-VolumesActionsTest-1396530288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:29 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b2f70f0a-56f0-4456-9296-b79991db7b8f tempest-VolumesActionsTest-1396530288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b2f70f0a-56f0-4456-9296-b79991db7b8f tempest-VolumesActionsTest-1396530288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2f70f0a-56f0-4456-9296-b79991db7b8f tempest-VolumesActionsTest-1396530288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:29 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:08:29 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:29 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1827e407-4f12-425e-8f68-8543ed360708 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.0c20d2bc-10f3-4374-9497-458fc0bc9175" returned: 0 in 0.372s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1827e407-4f12-425e-8f68-8543ed360708 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:29 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2f70f0a-56f0-4456-9296-b79991db7b8f tempest-VolumesActionsTest-1396530288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.340s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:29 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b2f70f0a-56f0-4456-9296-b79991db7b8f tempest-VolumesActionsTest-1396530288 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:08:29 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.info Sep 05 05:08:29 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:29 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-b2f70f0a-56f0-4456-9296-b79991db7b8f tempest-VolumesActionsTest-1396530288 None] Deleted volume successfully. Sep 05 05:08:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2f70f0a-56f0-4456-9296-b79991db7b8f tempest-VolumesActionsTest-1396530288 None] Lock "cinder-80f23f25-016d-496d-a870-7d6138477cfe-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:30 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1827e407-4f12-425e-8f68-8543ed360708 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.info" returned: 0 in 0.314s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:30 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-1827e407-4f12-425e-8f68-8543ed360708 tempest-GroupSnapshotsTest-1729556448 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 05:08:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1827e407-4f12-425e-8f68-8543ed360708 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:30 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.info Sep 05 05:08:30 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:30 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1827e407-4f12-425e-8f68-8543ed360708 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.info" returned: 0 in 0.316s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1827e407-4f12-425e-8f68-8543ed360708 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.741s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:30 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-1827e407-4f12-425e-8f68-8543ed360708 tempest-GroupSnapshotsTest-1729556448 None] group_snapshot 2d34439b-e561-4aa1-975c-1792a512c894: created successfully Sep 05 05:08:30 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Flow 'volume_create_manager' (0a213a3a-b40e-4699-a80a-7689fc97808c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68936f03-d16d-46cb-86ac-a74348db4fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68936f03-d16d-46cb-86ac-a74348db4fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-53164518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1019326-ae69-4918-91f1-07750918d8f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ce7ba0ba31e4aae9795f97aa9676155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:31Z,use_quota=True,user_id='d428d5b97c2a48eb9a06b06d1785a486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a39a4040-80eb-4262-81f3-01f0cc7fc139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a39a4040-80eb-4262-81f3-01f0cc7fc139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28519dd-8897-49a3-9aa4-9d6a7b801a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28519dd-8897-49a3-9aa4-9d6a7b801a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1019326-ae69-4918-91f1-07750918d8f4', 'volume_name': 'volume-b1019326-ae69-4918-91f1-07750918d8f4', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0a2da2-ae69-4722-959a-38520205cef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0a2da2-ae69-4722-959a-38520205cef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e80fb939-8798-4343-acd8-26b526be1902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:31 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Volume b1019326-ae69-4918-91f1-07750918d8f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1019326-ae69-4918-91f1-07750918d8f4', 'volume_size': 1} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-53164518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1019326-ae69-4918-91f1-07750918d8f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ce7ba0ba31e4aae9795f97aa9676155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:31Z,use_quota=True,user_id='d428d5b97c2a48eb9a06b06d1785a486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Creating volume b1019326-ae69-4918-91f1-07750918d8f4 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:08:31 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b1019326-ae69-4918-91f1-07750918d8f4 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:31 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b1019326-ae69-4918-91f1-07750918d8f4 1073741824 Sep 05 05:08:31 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Flow 'volume_create_manager' (6e192c57-f17e-40b4-92f3-d49e9f3b6f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95606ce-0672-48c6-b8d8-8fd9e2df441f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95606ce-0672-48c6-b8d8-8fd9e2df441f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-519334773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80930effaa3b4b0fa26cc55d32c5292b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:31Z,use_quota=True,user_id='acac602cc4644dc98ca1bab773db38ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199a3c96-bfdb-4846-b5f4-b5e0cf1f2108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199a3c96-bfdb-4846-b5f4-b5e0cf1f2108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f30756c-0a80-4155-9206-79f4523793c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f30756c-0a80-4155-9206-79f4523793c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe', 'volume_name': 'volume-b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5db98e-3566-4b59-95da-5510e49fb0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5db98e-3566-4b59-95da-5510e49fb0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7ad406-e1a6-4acb-aff1-2aebe833114c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:31 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Volume b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe', 'volume_size': 1} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:31 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b1019326-ae69-4918-91f1-07750918d8f4 1073741824" returned: 0 in 0.462s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b1019326-ae69-4918-91f1-07750918d8f4 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:31 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b1019326-ae69-4918-91f1-07750918d8f4 Sep 05 05:08:31 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:31 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-fa774147-3a78-4614-b122-921c331f1352 tempest-GroupSnapshotsTest-1729556448 None] group_snapshot 2d34439b-e561-4aa1-975c-1792a512c894: deleting Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fa774147-3a78-4614-b122-921c331f1352 tempest-GroupSnapshotsTest-1729556448 None] group_snapshot 2d34439b-e561-4aa1-975c-1792a512c894: deleting {{(pid=89331) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fa774147-3a78-4614-b122-921c331f1352 tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "cinder-quobyte-725c3821-5dca-4ee8-993c-fcaf69178e9b" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fa774147-3a78-4614-b122-921c331f1352 tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-725c3821-5dca-4ee8-993c-fcaf69178e9b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fa774147-3a78-4614-b122-921c331f1352 tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "cinder-quobyte-0c20d2bc-10f3-4374-9497-458fc0bc9175" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fa774147-3a78-4614-b122-921c331f1352 tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-0c20d2bc-10f3-4374-9497-458fc0bc9175" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-fa774147-3a78-4614-b122-921c331f1352 tempest-GroupSnapshotsTest-1729556448 None] Deleting offline snapshot 0c20d2bc-10f3-4374-9497-458fc0bc9175 of volume 725c3821-5dca-4ee8-993c-fcaf69178e9b {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-fa774147-3a78-4614-b122-921c331f1352 tempest-GroupSnapshotsTest-1729556448 None] snapshot_file for this snap is: volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.0c20d2bc-10f3-4374-9497-458fc0bc9175 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9060610c-6b34-4dde-a9a4-a13830507ebc]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa774147-3a78-4614-b122-921c331f1352 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.0c20d2bc-10f3-4374-9497-458fc0bc9175 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:31 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b1019326-ae69-4918-91f1-07750918d8f4" returned: 0 in 0.324s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.594s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-519334773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80930effaa3b4b0fa26cc55d32c5292b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:31Z,use_quota=True,user_id='acac602cc4644dc98ca1bab773db38ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Creating volume b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:08:31 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e80fb939-8798-4343-acd8-26b526be1902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1019326-ae69-4918-91f1-07750918d8f4', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cdc37df-c75d-4ca4-9dba-785f288b391c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:31 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe 1073741824 Sep 05 05:08:31 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:31 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.0c20d2bc-10f3-4374-9497-458fc0bc9175 Sep 05 05:08:31 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:32 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Volume volume-b1019326-ae69-4918-91f1-07750918d8f4 (b1019326-ae69-4918-91f1-07750918d8f4): created successfully Sep 05 05:08:32 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cdc37df-c75d-4ca4-9dba-785f288b391c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:32 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Flow 'volume_create_manager' (0a213a3a-b40e-4699-a80a-7689fc97808c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:32 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-90f2c5d7-1785-4c64-9b1b-05f486113099 tempest-ServersNegativeTestJSON-1677716532 None] Created volume successfully. Sep 05 05:08:32 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa774147-3a78-4614-b122-921c331f1352 tempest-GroupSnapshotsTest-1729556448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.0c20d2bc-10f3-4374-9497-458fc0bc9175" returned: 0 in 0.451s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:32 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-fa774147-3a78-4614-b122-921c331f1352 tempest-GroupSnapshotsTest-1729556448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-725c3821-5dca-4ee8-993c-fcaf69178e9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:08:32 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9028404-1ab5-4e3c-827f-3a80f1abae8f]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa774147-3a78-4614-b122-921c331f1352 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:32 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b Sep 05 05:08:32 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:32 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe 1073741824" returned: 0 in 0.504s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:32 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe Sep 05 05:08:32 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:32 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa774147-3a78-4614-b122-921c331f1352 tempest-GroupSnapshotsTest-1729556448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b" returned: 0 in 0.378s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa774147-3a78-4614-b122-921c331f1352 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.0c20d2bc-10f3-4374-9497-458fc0bc9175 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:32 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.0c20d2bc-10f3-4374-9497-458fc0bc9175 Sep 05 05:08:32 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:32 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe" returned: 0 in 0.265s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:32 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:08:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:32 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7ad406-e1a6-4acb-aff1-2aebe833114c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:32 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8392966-7a3c-408b-846e-61542012e0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:32 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Volume volume-b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe (b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe): created successfully Sep 05 05:08:32 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8392966-7a3c-408b-846e-61542012e0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:32 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Flow 'volume_create_manager' (6e192c57-f17e-40b4-92f3-d49e9f3b6f3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:32 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-5c6b8ba7-8463-405f-8a6e-670332f234b2 tempest-VolumesActionsTest-818028394 None] Created volume successfully. Sep 05 05:08:33 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa774147-3a78-4614-b122-921c331f1352 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.0c20d2bc-10f3-4374-9497-458fc0bc9175" returned: 0 in 0.383s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa774147-3a78-4614-b122-921c331f1352 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.0c20d2bc-10f3-4374-9497-458fc0bc9175 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:33 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.0c20d2bc-10f3-4374-9497-458fc0bc9175 Sep 05 05:08:33 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:08:33 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Flow 'volume_create_manager' (b1ddf19d-0361-41f2-914e-b1b1a8bf1dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c394fe4-43c0-450b-93f3-2683416bb402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa774147-3a78-4614-b122-921c331f1352 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b.0c20d2bc-10f3-4374-9497-458fc0bc9175" returned: 0 in 0.388s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c394fe4-43c0-450b-93f3-2683416bb402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1389428859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7820654d-6ad5-4ab4-ae69-4d9f8484f774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f692f0496a9f4828a9b2c417fff3a071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:33Z,use_quota=True,user_id='9745309e5a9f436eb321d4d50f583b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59657442-1854-45af-b044-2b4d67d077d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59657442-1854-45af-b044-2b4d67d077d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b38e4b-ce72-4028-88aa-70b9086eb282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b38e4b-ce72-4028-88aa-70b9086eb282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7820654d-6ad5-4ab4-ae69-4d9f8484f774', 'volume_name': 'volume-7820654d-6ad5-4ab4-ae69-4d9f8484f774', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e750eed3-582a-4776-9970-909fccade6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e750eed3-582a-4776-9970-909fccade6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (446ffbbe-b82f-45a2-acaf-6ff1e76185af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:33 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Volume 7820654d-6ad5-4ab4-ae69-4d9f8484f774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7820654d-6ad5-4ab4-ae69-4d9f8484f774', 'volume_size': 1} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1389428859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7820654d-6ad5-4ab4-ae69-4d9f8484f774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f692f0496a9f4828a9b2c417fff3a071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:33Z,use_quota=True,user_id='9745309e5a9f436eb321d4d50f583b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Creating volume 7820654d-6ad5-4ab4-ae69-4d9f8484f774 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:08:33 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7820654d-6ad5-4ab4-ae69-4d9f8484f774 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fa774147-3a78-4614-b122-921c331f1352 tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-0c20d2bc-10f3-4374-9497-458fc0bc9175" released by "_delete_snapshot" :: held 1.788s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-66f79f34-6db4-439a-83c4-06a230f4f131 tempest-ServersNegativeTestJSON-1677716532 None] Acquiring lock "cinder-b1019326-ae69-4918-91f1-07750918d8f4-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fa774147-3a78-4614-b122-921c331f1352 tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-725c3821-5dca-4ee8-993c-fcaf69178e9b" released by "delete_snapshot" :: held 1.833s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:33 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7820654d-6ad5-4ab4-ae69-4d9f8484f774 1073741824 Sep 05 05:08:33 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-66f79f34-6db4-439a-83c4-06a230f4f131 tempest-ServersNegativeTestJSON-1677716532 None] Lock "cinder-b1019326-ae69-4918-91f1-07750918d8f4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-66f79f34-6db4-439a-83c4-06a230f4f131 tempest-ServersNegativeTestJSON-1677716532 None] Acquiring lock "cinder-quobyte-b1019326-ae69-4918-91f1-07750918d8f4" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-66f79f34-6db4-439a-83c4-06a230f4f131 tempest-ServersNegativeTestJSON-1677716532 None] Lock "cinder-quobyte-b1019326-ae69-4918-91f1-07750918d8f4" acquired by "delete_volume" :: waited 0.029s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:33 devstack cinder-volume[89331]: WARNING cinder.quota [None req-fa774147-3a78-4614-b122-921c331f1352 tempest-GroupSnapshotsTest-1729556448 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-841121398 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-841121398, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:08:33 devstack cinder-volume[89331]: WARNING cinder.quota [None req-fa774147-3a78-4614-b122-921c331f1352 tempest-GroupSnapshotsTest-1729556448 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-841121398 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-841121398, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02e4def-9dd1-4e5f-825f-96d9f2d3b593]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-66f79f34-6db4-439a-83c4-06a230f4f131 tempest-ServersNegativeTestJSON-1677716532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b1019326-ae69-4918-91f1-07750918d8f4 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:33 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-fa774147-3a78-4614-b122-921c331f1352 tempest-GroupSnapshotsTest-1729556448 None] Created reservations ['f12e3e61-8227-4a1f-bc75-bc8d3492242f', '5ba5f423-f02b-40b1-bf3a-cbf2bc31341d', 'e0fb88f2-fade-46a9-9ad6-15cdc4be2506', '83d05ff4-0e62-4b41-a277-6684d68f2c41'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:08:33 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-fa774147-3a78-4614-b122-921c331f1352 tempest-GroupSnapshotsTest-1729556448 None] group_snapshot 2d34439b-e561-4aa1-975c-1792a512c894: deleted successfully Sep 05 05:08:33 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b1019326-ae69-4918-91f1-07750918d8f4 Sep 05 05:08:33 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:34 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7820654d-6ad5-4ab4-ae69-4d9f8484f774 1073741824" returned: 0 in 0.636s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7820654d-6ad5-4ab4-ae69-4d9f8484f774 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:34 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7820654d-6ad5-4ab4-ae69-4d9f8484f774 Sep 05 05:08:34 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:34 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3b25b329-2795-44a8-96d1-de8ad7fba8ef tempest-VolumesActionsTest-818028394 None] Acquiring lock "cinder-b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-66f79f34-6db4-439a-83c4-06a230f4f131 tempest-ServersNegativeTestJSON-1677716532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b1019326-ae69-4918-91f1-07750918d8f4" returned: 0 in 0.534s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-66f79f34-6db4-439a-83c4-06a230f4f131 tempest-ServersNegativeTestJSON-1677716532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b1019326-ae69-4918-91f1-07750918d8f4 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3b25b329-2795-44a8-96d1-de8ad7fba8ef tempest-VolumesActionsTest-818028394 None] Lock "cinder-b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:34 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b1019326-ae69-4918-91f1-07750918d8f4 Sep 05 05:08:34 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3b25b329-2795-44a8-96d1-de8ad7fba8ef tempest-VolumesActionsTest-818028394 None] Acquiring lock "cinder-quobyte-b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3b25b329-2795-44a8-96d1-de8ad7fba8ef tempest-VolumesActionsTest-818028394 None] Lock "cinder-quobyte-b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe" acquired by "delete_volume" :: waited 0.043s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b66c13-6e7f-4322-ac48-7edf185e389d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3b25b329-2795-44a8-96d1-de8ad7fba8ef tempest-VolumesActionsTest-818028394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-98ac9811-ea9a-4be9-938b-34f028fc2236 tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "cinder-quobyte-725c3821-5dca-4ee8-993c-fcaf69178e9b" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-98ac9811-ea9a-4be9-938b-34f028fc2236 tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-725c3821-5dca-4ee8-993c-fcaf69178e9b" acquired by "delete_volume" :: waited 0.030s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:34 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7820654d-6ad5-4ab4-ae69-4d9f8484f774" returned: 0 in 0.346s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef1bdf8-f6f8-4aec-8004-ec0d0a7c9fd5]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-98ac9811-ea9a-4be9-938b-34f028fc2236 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (446ffbbe-b82f-45a2-acaf-6ff1e76185af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7820654d-6ad5-4ab4-ae69-4d9f8484f774', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2b6607-8c62-443a-b775-d2c610ced7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:34 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Volume volume-7820654d-6ad5-4ab4-ae69-4d9f8484f774 (7820654d-6ad5-4ab4-ae69-4d9f8484f774): created successfully Sep 05 05:08:34 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2b6607-8c62-443a-b775-d2c610ced7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:34 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Flow 'volume_create_manager' (b1ddf19d-0361-41f2-914e-b1b1a8bf1dcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:34 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-66f79f34-6db4-439a-83c4-06a230f4f131 tempest-ServersNegativeTestJSON-1677716532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b1019326-ae69-4918-91f1-07750918d8f4" returned: 0 in 0.385s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:34 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-722ed6e7-1599-45be-bc54-1d375922cb3d tempest-VolumeQuotasNegativeTestJSON-215929339 None] Created volume successfully. Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-66f79f34-6db4-439a-83c4-06a230f4f131 tempest-ServersNegativeTestJSON-1677716532 None] Lock "cinder-quobyte-b1019326-ae69-4918-91f1-07750918d8f4" released by "delete_volume" :: held 0.983s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:34 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b Sep 05 05:08:34 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-66f79f34-6db4-439a-83c4-06a230f4f131 tempest-ServersNegativeTestJSON-1677716532 None] Created reservations ['a457641b-5dc2-4649-88cd-d9f61f3ae42a', '4c1fcc8f-ab30-4b94-aecd-8b9fb3ce7e75', 'd70eb608-cf4d-483d-be4a-761a34b2a3bf', '76c89469-3987-4687-919c-47978d9bc7dc'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-66f79f34-6db4-439a-83c4-06a230f4f131 tempest-ServersNegativeTestJSON-1677716532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-66f79f34-6db4-439a-83c4-06a230f4f131 tempest-ServersNegativeTestJSON-1677716532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-66f79f34-6db4-439a-83c4-06a230f4f131 tempest-ServersNegativeTestJSON-1677716532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-66f79f34-6db4-439a-83c4-06a230f4f131 tempest-ServersNegativeTestJSON-1677716532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-66f79f34-6db4-439a-83c4-06a230f4f131 tempest-ServersNegativeTestJSON-1677716532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-66f79f34-6db4-439a-83c4-06a230f4f131 tempest-ServersNegativeTestJSON-1677716532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:34 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:08:34 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:34 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3b25b329-2795-44a8-96d1-de8ad7fba8ef tempest-VolumesActionsTest-818028394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe" returned: 0 in 0.440s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3b25b329-2795-44a8-96d1-de8ad7fba8ef tempest-VolumesActionsTest-818028394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:34 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe Sep 05 05:08:34 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:35 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-98ac9811-ea9a-4be9-938b-34f028fc2236 tempest-GroupSnapshotsTest-1729556448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b" returned: 0 in 0.412s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-98ac9811-ea9a-4be9-938b-34f028fc2236 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:35 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b Sep 05 05:08:35 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:35 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-66f79f34-6db4-439a-83c4-06a230f4f131 tempest-ServersNegativeTestJSON-1677716532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.259s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-66f79f34-6db4-439a-83c4-06a230f4f131 tempest-ServersNegativeTestJSON-1677716532 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:08:35 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-66f79f34-6db4-439a-83c4-06a230f4f131 tempest-ServersNegativeTestJSON-1677716532 None] Deleted volume successfully. Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-66f79f34-6db4-439a-83c4-06a230f4f131 tempest-ServersNegativeTestJSON-1677716532 None] Lock "cinder-b1019326-ae69-4918-91f1-07750918d8f4-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:35 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3b25b329-2795-44a8-96d1-de8ad7fba8ef tempest-VolumesActionsTest-818028394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe" returned: 0 in 0.272s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3b25b329-2795-44a8-96d1-de8ad7fba8ef tempest-VolumesActionsTest-818028394 None] Lock "cinder-quobyte-b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe" released by "delete_volume" :: held 0.766s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-3b25b329-2795-44a8-96d1-de8ad7fba8ef tempest-VolumesActionsTest-818028394 None] Created reservations ['c61a706c-23e8-4c6f-a2e1-986ad43b0d72', '5b846e02-46e6-4ff1-b5bf-621615783bcb', 'fc6c085c-d7fe-42d6-844e-4b167e9a457e', 'df1e52ff-36cf-4b51-a9b5-3c06310e55c8'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:08:35 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-98ac9811-ea9a-4be9-938b-34f028fc2236 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-725c3821-5dca-4ee8-993c-fcaf69178e9b" returned: 0 in 0.270s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-98ac9811-ea9a-4be9-938b-34f028fc2236 tempest-GroupSnapshotsTest-1729556448 None] Lock "cinder-quobyte-725c3821-5dca-4ee8-993c-fcaf69178e9b" released by "delete_volume" :: held 0.766s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3b25b329-2795-44a8-96d1-de8ad7fba8ef tempest-VolumesActionsTest-818028394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3b25b329-2795-44a8-96d1-de8ad7fba8ef tempest-VolumesActionsTest-818028394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3b25b329-2795-44a8-96d1-de8ad7fba8ef tempest-VolumesActionsTest-818028394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3b25b329-2795-44a8-96d1-de8ad7fba8ef tempest-VolumesActionsTest-818028394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3b25b329-2795-44a8-96d1-de8ad7fba8ef tempest-VolumesActionsTest-818028394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3b25b329-2795-44a8-96d1-de8ad7fba8ef tempest-VolumesActionsTest-818028394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=160,cinder:INSERT=46,cinder:UPDATE=178,cinder:DELETE=4 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:UPDATE=179,cinder:SELECT=158,cinder:INSERT=37,cinder:DELETE=14 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:08:35 devstack sudo[98222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:08:35 devstack sudo[98222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-98ac9811-ea9a-4be9-938b-34f028fc2236 tempest-GroupSnapshotsTest-1729556448 None] Created reservations ['8638692d-003d-46d3-b331-2ac7d0ad137b'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:08:35 devstack cinder-volume[89331]: WARNING cinder.quota [None req-98ac9811-ea9a-4be9-938b-34f028fc2236 tempest-GroupSnapshotsTest-1729556448 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-841121398 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-841121398, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-98ac9811-ea9a-4be9-938b-34f028fc2236 tempest-GroupSnapshotsTest-1729556448 None] Created reservations ['d5c5edd2-94f2-4a48-b516-0f4473f242b0', 'f537da0f-d21e-447c-800c-7fc32859aeeb', 'f76d41f7-e808-41ad-826a-5b62ad89714d', 'bfad4992-c017-45d7-84e7-65a2632406e1'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-98ac9811-ea9a-4be9-938b-34f028fc2236 tempest-GroupSnapshotsTest-1729556448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-98ac9811-ea9a-4be9-938b-34f028fc2236 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-98ac9811-ea9a-4be9-938b-34f028fc2236 tempest-GroupSnapshotsTest-1729556448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-98ac9811-ea9a-4be9-938b-34f028fc2236 tempest-GroupSnapshotsTest-1729556448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-98ac9811-ea9a-4be9-938b-34f028fc2236 tempest-GroupSnapshotsTest-1729556448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-98ac9811-ea9a-4be9-938b-34f028fc2236 tempest-GroupSnapshotsTest-1729556448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:35 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:08:35 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:35 devstack sudo[98222]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3b25b329-2795-44a8-96d1-de8ad7fba8ef tempest-VolumesActionsTest-818028394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.328s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-3b25b329-2795-44a8-96d1-de8ad7fba8ef tempest-VolumesActionsTest-818028394 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:08:35 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-3b25b329-2795-44a8-96d1-de8ad7fba8ef tempest-VolumesActionsTest-818028394 None] Deleted volume successfully. Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3b25b329-2795-44a8-96d1-de8ad7fba8ef tempest-VolumesActionsTest-818028394 None] Lock "cinder-b0ec7bb0-ba1d-4b3b-b8b5-d3c06e8cdabe-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:35 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-98ac9811-ea9a-4be9-938b-34f028fc2236 tempest-GroupSnapshotsTest-1729556448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.305s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-98ac9811-ea9a-4be9-938b-34f028fc2236 tempest-GroupSnapshotsTest-1729556448 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:08:35 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-98ac9811-ea9a-4be9-938b-34f028fc2236 tempest-GroupSnapshotsTest-1729556448 None] Delete group completed successfully. Sep 05 05:08:35 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-54893fa9-a36e-43f0-b9fb-3f0ab45ecb2c tempest-ServersNegativeTestJSON-1677716532 None] Acquiring lock "cinder-23473ff4-e264-453f-90f4-b5fcca4e1d68-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-54893fa9-a36e-43f0-b9fb-3f0ab45ecb2c tempest-ServersNegativeTestJSON-1677716532 None] Lock "cinder-23473ff4-e264-453f-90f4-b5fcca4e1d68-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-54893fa9-a36e-43f0-b9fb-3f0ab45ecb2c tempest-ServersNegativeTestJSON-1677716532 None] Acquiring lock "cinder-quobyte-23473ff4-e264-453f-90f4-b5fcca4e1d68" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-54893fa9-a36e-43f0-b9fb-3f0ab45ecb2c tempest-ServersNegativeTestJSON-1677716532 None] Lock "cinder-quobyte-23473ff4-e264-453f-90f4-b5fcca4e1d68" acquired by "delete_volume" :: waited 0.024s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:36 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5148739b-49fe-4616-b038-c20040ae72df]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-54893fa9-a36e-43f0-b9fb-3f0ab45ecb2c tempest-ServersNegativeTestJSON-1677716532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23473ff4-e264-453f-90f4-b5fcca4e1d68 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:36 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23473ff4-e264-453f-90f4-b5fcca4e1d68 Sep 05 05:08:36 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:36 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-54893fa9-a36e-43f0-b9fb-3f0ab45ecb2c tempest-ServersNegativeTestJSON-1677716532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23473ff4-e264-453f-90f4-b5fcca4e1d68" returned: 0 in 0.522s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-54893fa9-a36e-43f0-b9fb-3f0ab45ecb2c tempest-ServersNegativeTestJSON-1677716532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23473ff4-e264-453f-90f4-b5fcca4e1d68 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:36 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23473ff4-e264-453f-90f4-b5fcca4e1d68 Sep 05 05:08:36 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:36 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-54893fa9-a36e-43f0-b9fb-3f0ab45ecb2c tempest-ServersNegativeTestJSON-1677716532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23473ff4-e264-453f-90f4-b5fcca4e1d68" returned: 0 in 0.292s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-54893fa9-a36e-43f0-b9fb-3f0ab45ecb2c tempest-ServersNegativeTestJSON-1677716532 None] Lock "cinder-quobyte-23473ff4-e264-453f-90f4-b5fcca4e1d68" released by "delete_volume" :: held 0.873s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-96be751d-a1e7-405d-ab3f-7748db56f962 tempest-VolumeQuotasNegativeTestJSON-215929339 None] Acquiring lock "cinder-7820654d-6ad5-4ab4-ae69-4d9f8484f774-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-96be751d-a1e7-405d-ab3f-7748db56f962 tempest-VolumeQuotasNegativeTestJSON-215929339 None] Lock "cinder-7820654d-6ad5-4ab4-ae69-4d9f8484f774-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:37 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-54893fa9-a36e-43f0-b9fb-3f0ab45ecb2c tempest-ServersNegativeTestJSON-1677716532 None] Created reservations ['b27e4c71-1cf0-4a77-9e2a-6f88b0265e3d', '4f5b97a1-a9ff-4ca0-bd6a-35dc42a61ccd', 'a8ad2ebc-367f-4c2c-949c-6eef3befa7fe', 'd25234b9-266c-4c63-aca3-d67a513ce4b7'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:08:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-96be751d-a1e7-405d-ab3f-7748db56f962 tempest-VolumeQuotasNegativeTestJSON-215929339 None] Acquiring lock "cinder-quobyte-7820654d-6ad5-4ab4-ae69-4d9f8484f774" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-96be751d-a1e7-405d-ab3f-7748db56f962 tempest-VolumeQuotasNegativeTestJSON-215929339 None] Lock "cinder-quobyte-7820654d-6ad5-4ab4-ae69-4d9f8484f774" acquired by "delete_volume" :: waited 0.040s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:37 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a9b2d4-6edf-4fb2-af3d-188cc3d07f59]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-96be751d-a1e7-405d-ab3f-7748db56f962 tempest-VolumeQuotasNegativeTestJSON-215929339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7820654d-6ad5-4ab4-ae69-4d9f8484f774 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-54893fa9-a36e-43f0-b9fb-3f0ab45ecb2c tempest-ServersNegativeTestJSON-1677716532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-54893fa9-a36e-43f0-b9fb-3f0ab45ecb2c tempest-ServersNegativeTestJSON-1677716532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:37 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-54893fa9-a36e-43f0-b9fb-3f0ab45ecb2c tempest-ServersNegativeTestJSON-1677716532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:37 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-54893fa9-a36e-43f0-b9fb-3f0ab45ecb2c tempest-ServersNegativeTestJSON-1677716532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-54893fa9-a36e-43f0-b9fb-3f0ab45ecb2c tempest-ServersNegativeTestJSON-1677716532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-54893fa9-a36e-43f0-b9fb-3f0ab45ecb2c tempest-ServersNegativeTestJSON-1677716532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:37 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:08:37 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:37 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7820654d-6ad5-4ab4-ae69-4d9f8484f774 Sep 05 05:08:37 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:37 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-54893fa9-a36e-43f0-b9fb-3f0ab45ecb2c tempest-ServersNegativeTestJSON-1677716532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.279s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:37 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-54893fa9-a36e-43f0-b9fb-3f0ab45ecb2c tempest-ServersNegativeTestJSON-1677716532 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:08:37 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-54893fa9-a36e-43f0-b9fb-3f0ab45ecb2c tempest-ServersNegativeTestJSON-1677716532 None] Deleted volume successfully. Sep 05 05:08:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-54893fa9-a36e-43f0-b9fb-3f0ab45ecb2c tempest-ServersNegativeTestJSON-1677716532 None] Lock "cinder-23473ff4-e264-453f-90f4-b5fcca4e1d68-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:37 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-96be751d-a1e7-405d-ab3f-7748db56f962 tempest-VolumeQuotasNegativeTestJSON-215929339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7820654d-6ad5-4ab4-ae69-4d9f8484f774" returned: 0 in 0.462s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-96be751d-a1e7-405d-ab3f-7748db56f962 tempest-VolumeQuotasNegativeTestJSON-215929339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7820654d-6ad5-4ab4-ae69-4d9f8484f774 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:37 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7820654d-6ad5-4ab4-ae69-4d9f8484f774 Sep 05 05:08:37 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:37 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-96be751d-a1e7-405d-ab3f-7748db56f962 tempest-VolumeQuotasNegativeTestJSON-215929339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7820654d-6ad5-4ab4-ae69-4d9f8484f774" returned: 0 in 0.292s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-96be751d-a1e7-405d-ab3f-7748db56f962 tempest-VolumeQuotasNegativeTestJSON-215929339 None] Lock "cinder-quobyte-7820654d-6ad5-4ab4-ae69-4d9f8484f774" released by "delete_volume" :: held 0.814s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:38 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-96be751d-a1e7-405d-ab3f-7748db56f962 tempest-VolumeQuotasNegativeTestJSON-215929339 None] Created reservations ['23f254b4-b9c9-4f3a-b4c0-f940bf81aa73', '64906830-e2db-471b-bd7a-33e0515ca403', 'eeb92709-f85c-4347-9d87-8d09c94df361', '6bf859c3-3ff9-44eb-ae3c-66f483ced2e9'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:08:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-96be751d-a1e7-405d-ab3f-7748db56f962 tempest-VolumeQuotasNegativeTestJSON-215929339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-96be751d-a1e7-405d-ab3f-7748db56f962 tempest-VolumeQuotasNegativeTestJSON-215929339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:38 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-96be751d-a1e7-405d-ab3f-7748db56f962 tempest-VolumeQuotasNegativeTestJSON-215929339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:38 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-96be751d-a1e7-405d-ab3f-7748db56f962 tempest-VolumeQuotasNegativeTestJSON-215929339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-96be751d-a1e7-405d-ab3f-7748db56f962 tempest-VolumeQuotasNegativeTestJSON-215929339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-96be751d-a1e7-405d-ab3f-7748db56f962 tempest-VolumeQuotasNegativeTestJSON-215929339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:38 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:08:38 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:38 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-96be751d-a1e7-405d-ab3f-7748db56f962 tempest-VolumeQuotasNegativeTestJSON-215929339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.365s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:38 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-96be751d-a1e7-405d-ab3f-7748db56f962 tempest-VolumeQuotasNegativeTestJSON-215929339 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:08:38 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-96be751d-a1e7-405d-ab3f-7748db56f962 tempest-VolumeQuotasNegativeTestJSON-215929339 None] Deleted volume successfully. Sep 05 05:08:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-96be751d-a1e7-405d-ab3f-7748db56f962 tempest-VolumeQuotasNegativeTestJSON-215929339 None] Lock "cinder-7820654d-6ad5-4ab4-ae69-4d9f8484f774-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:44 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-1f3324e9-a627-4e06-a39a-83eaf2929476 tempest-GroupsTest-734701814 None] Group tempest-Group1-1196824470: creating Sep 05 05:08:44 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-1f3324e9-a627-4e06-a39a-83eaf2929476 tempest-GroupsTest-734701814 None] Group tempest-Group1-1196824470: created successfully Sep 05 05:08:44 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-1f3324e9-a627-4e06-a39a-83eaf2929476 tempest-GroupsTest-734701814 None] Create group completed successfully. Sep 05 05:08:45 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-6d536418-c7a2-4ec7-82d7-4e7c7d067482 tempest-GroupsTest-734701814 None] Group tempest-Group2-1662490288: creating Sep 05 05:08:45 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-6d536418-c7a2-4ec7-82d7-4e7c7d067482 tempest-GroupsTest-734701814 None] Group tempest-Group2-1662490288: created successfully Sep 05 05:08:45 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-6d536418-c7a2-4ec7-82d7-4e7c7d067482 tempest-GroupsTest-734701814 None] Create group completed successfully. Sep 05 05:08:46 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:08:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Flow 'volume_create_manager' (3a04a3fd-d60b-4ec1-9a1f-80e0dd4a4685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be978a7-00cb-4032-9a9e-7039628b4327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be978a7-00cb-4032-9a9e-7039628b4327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2134180796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88782118-eb9f-41f1-abfe-4081505c5fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae6b87ea429402880939f15377463af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:47Z,use_quota=True,user_id='170b78c1d45141acbb06715ed3c0bc8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdefd91f-3d73-4424-be09-84415466ebc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdefd91f-3d73-4424-be09-84415466ebc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba8048d-c507-4d9c-9e80-510efeb40093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba8048d-c507-4d9c-9e80-510efeb40093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88782118-eb9f-41f1-abfe-4081505c5fd8', 'volume_name': 'volume-88782118-eb9f-41f1-abfe-4081505c5fd8', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (108c748c-73c6-4f2c-a4f5-fdd19cc52ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (108c748c-73c6-4f2c-a4f5-fdd19cc52ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30113b3-f738-4f2f-89e2-47b76deeeabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:46 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Volume 88782118-eb9f-41f1-abfe-4081505c5fd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88782118-eb9f-41f1-abfe-4081505c5fd8', 'volume_size': 1} Sep 05 05:08:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:46 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2134180796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88782118-eb9f-41f1-abfe-4081505c5fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae6b87ea429402880939f15377463af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:47Z,use_quota=True,user_id='170b78c1d45141acbb06715ed3c0bc8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:08:46 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Creating volume 88782118-eb9f-41f1-abfe-4081505c5fd8 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:08:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:46 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:08:47 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:08:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:47 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8 1073741824 Sep 05 05:08:47 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:47 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:08:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Flow 'volume_create_manager' (8bbd8ceb-852b-4c7c-8b0c-2d125917b66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b7be3c1-45d7-406c-a061-499c382fa47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b7be3c1-45d7-406c-a061-499c382fa47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-811579573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=02c5f683-d114-4122-96f5-da42f2c0c84e,host='devstack@QuobyteHD#QuobyteHD',id=33943f26-0341-4ef4-8799-4381d9e91361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4200fd17fc3d495a93a917380ce7d625',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:47Z,use_quota=True,user_id='003c205ee909425e8d3124710010a675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef0b4849-2b37-4705-8375-a0d678ec2f11),volume_type_id=ef0b4849-2b37-4705-8375-a0d678ec2f11)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58ef3e1-694c-4e2d-a635-6cac815dd419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58ef3e1-694c-4e2d-a635-6cac815dd419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6dd21a-b969-4ad1-af6e-2af39ab165de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6dd21a-b969-4ad1-af6e-2af39ab165de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33943f26-0341-4ef4-8799-4381d9e91361', 'volume_name': 'volume-33943f26-0341-4ef4-8799-4381d9e91361', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af374671-19f8-4c46-9980-a80652e7cd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af374671-19f8-4c46-9980-a80652e7cd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cb01b0-dd5f-4957-9bd5-52cb9455b704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:47 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Volume 33943f26-0341-4ef4-8799-4381d9e91361: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33943f26-0341-4ef4-8799-4381d9e91361', 'volume_size': 1} Sep 05 05:08:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:47 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8 1073741824" returned: 0 in 0.649s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:47 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8 Sep 05 05:08:47 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:47 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8" returned: 0 in 0.301s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.534s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=02c5f683-d114-4122-96f5-da42f2c0c84e,created_at=2026-09-05T03:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-811579573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=02c5f683-d114-4122-96f5-da42f2c0c84e,host='devstack@QuobyteHD#QuobyteHD',id=33943f26-0341-4ef4-8799-4381d9e91361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4200fd17fc3d495a93a917380ce7d625',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:47Z,use_quota=True,user_id='003c205ee909425e8d3124710010a675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef0b4849-2b37-4705-8375-a0d678ec2f11),volume_type_id=ef0b4849-2b37-4705-8375-a0d678ec2f11)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Creating volume 33943f26-0341-4ef4-8799-4381d9e91361 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:08:48 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-33943f26-0341-4ef4-8799-4381d9e91361 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30113b3-f738-4f2f-89e2-47b76deeeabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88782118-eb9f-41f1-abfe-4081505c5fd8', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:48 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-33943f26-0341-4ef4-8799-4381d9e91361 1073741824 Sep 05 05:08:48 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f659c1-ba26-4e43-9d9f-31c259cdb5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:48 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Volume volume-88782118-eb9f-41f1-abfe-4081505c5fd8 (88782118-eb9f-41f1-abfe-4081505c5fd8): created successfully Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f659c1-ba26-4e43-9d9f-31c259cdb5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Flow 'volume_create_manager' (3a04a3fd-d60b-4ec1-9a1f-80e0dd4a4685) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:48 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-213b17be-595b-4e77-a090-4314fc266b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Created volume successfully. Sep 05 05:08:48 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-33943f26-0341-4ef4-8799-4381d9e91361 1073741824" returned: 0 in 0.574s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-33943f26-0341-4ef4-8799-4381d9e91361 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:48 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-33943f26-0341-4ef4-8799-4381d9e91361 Sep 05 05:08:48 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:48 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-33943f26-0341-4ef4-8799-4381d9e91361" returned: 0 in 0.276s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cb01b0-dd5f-4957-9bd5-52cb9455b704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33943f26-0341-4ef4-8799-4381d9e91361', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6cf25c8-f2b5-4f84-a731-4bcdb1faceaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:48 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Volume volume-33943f26-0341-4ef4-8799-4381d9e91361 (33943f26-0341-4ef4-8799-4381d9e91361): created successfully Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6cf25c8-f2b5-4f84-a731-4bcdb1faceaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Flow 'volume_create_manager' (8bbd8ceb-852b-4c7c-8b0c-2d125917b66a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:49 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-72128cd6-1d36-439d-94ea-90a50a988417 tempest-GroupsTest-734701814 None] Created volume successfully. Sep 05 05:08:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-485d0273-f2f1-4795-9174-ea4a6bc891a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-485d0273-f2f1-4795-9174-ea4a6bc891a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-485d0273-f2f1-4795-9174-ea4a6bc891a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Creating offline snapshot 685500ba-f786-46ef-87f3-a896488c0a6c of volume 88782118-eb9f-41f1-abfe-4081505c5fd8 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:08:49 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e380c3-70c5-4093-875a-bec57137c29b]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-485d0273-f2f1-4795-9174-ea4a6bc891a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:49 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8 Sep 05 05:08:49 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:08:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:49 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:08:49 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:49 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-485d0273-f2f1-4795-9174-ea4a6bc891a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8" returned: 0 in 0.469s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-485d0273-f2f1-4795-9174-ea4a6bc891a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.685500ba-f786-46ef-87f3-a896488c0a6c 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:49 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.685500ba-f786-46ef-87f3-a896488c0a6c 1G Sep 05 05:08:49 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:49 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.286s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:49 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:08:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager._thread_info {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:08:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread count: 28 {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 05:08:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread info: [<_MainThread(MainThread, started 139182109970560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 05:08:50 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-485d0273-f2f1-4795-9174-ea4a6bc891a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.685500ba-f786-46ef-87f3-a896488c0a6c 1G" returned: 0 in 0.624s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-485d0273-f2f1-4795-9174-ea4a6bc891a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88782118-eb9f-41f1-abfe-4081505c5fd8 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.685500ba-f786-46ef-87f3-a896488c0a6c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:50 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88782118-eb9f-41f1-abfe-4081505c5fd8 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.685500ba-f786-46ef-87f3-a896488c0a6c Sep 05 05:08:50 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:50 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-be63764c-fe9c-43f4-9c13-800f01aaf23c tempest-GroupsTest-734701814 None] Acquiring lock "cinder-quobyte-33943f26-0341-4ef4-8799-4381d9e91361" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:50 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-be63764c-fe9c-43f4-9c13-800f01aaf23c tempest-GroupsTest-734701814 None] Lock "cinder-quobyte-33943f26-0341-4ef4-8799-4381d9e91361" acquired by "delete_volume" :: waited 0.029s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:50 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c8d6bc-aba8-4c98-9bc9-b1e023d314e6]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-be63764c-fe9c-43f4-9c13-800f01aaf23c tempest-GroupsTest-734701814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-33943f26-0341-4ef4-8799-4381d9e91361 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:50 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-485d0273-f2f1-4795-9174-ea4a6bc891a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88782118-eb9f-41f1-abfe-4081505c5fd8 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.685500ba-f786-46ef-87f3-a896488c0a6c" returned: 0 in 0.382s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:50 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-485d0273-f2f1-4795-9174-ea4a6bc891a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.685500ba-f786-46ef-87f3-a896488c0a6c is being set with open permissions: ugo+rw Sep 05 05:08:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-485d0273-f2f1-4795-9174-ea4a6bc891a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.685500ba-f786-46ef-87f3-a896488c0a6c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:50 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.685500ba-f786-46ef-87f3-a896488c0a6c Sep 05 05:08:50 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:50 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-33943f26-0341-4ef4-8799-4381d9e91361 Sep 05 05:08:50 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:51 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-485d0273-f2f1-4795-9174-ea4a6bc891a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.685500ba-f786-46ef-87f3-a896488c0a6c" returned: 0 in 0.342s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:51 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-be63764c-fe9c-43f4-9c13-800f01aaf23c tempest-GroupsTest-734701814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-33943f26-0341-4ef4-8799-4381d9e91361" returned: 0 in 0.486s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-be63764c-fe9c-43f4-9c13-800f01aaf23c tempest-GroupsTest-734701814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-33943f26-0341-4ef4-8799-4381d9e91361 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-485d0273-f2f1-4795-9174-ea4a6bc891a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:51 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-33943f26-0341-4ef4-8799-4381d9e91361 Sep 05 05:08:51 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:51 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.info Sep 05 05:08:51 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:51 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-be63764c-fe9c-43f4-9c13-800f01aaf23c tempest-GroupsTest-734701814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-33943f26-0341-4ef4-8799-4381d9e91361" returned: 0 in 0.307s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:51 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-485d0273-f2f1-4795-9174-ea4a6bc891a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.info" returned: 0 in 0.301s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:51 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-485d0273-f2f1-4795-9174-ea4a6bc891a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.info is being set with open permissions: ugo+rw Sep 05 05:08:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-485d0273-f2f1-4795-9174-ea4a6bc891a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:51 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-be63764c-fe9c-43f4-9c13-800f01aaf23c tempest-GroupsTest-734701814 None] Lock "cinder-quobyte-33943f26-0341-4ef4-8799-4381d9e91361" released by "delete_volume" :: held 0.860s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:51 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.info Sep 05 05:08:51 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:51 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-be63764c-fe9c-43f4-9c13-800f01aaf23c tempest-GroupsTest-734701814 None] Created reservations ['1e0dd186-7b20-42d6-99cb-e6883b4851e7'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:08:51 devstack cinder-volume[89331]: WARNING cinder.quota [None req-be63764c-fe9c-43f4-9c13-800f01aaf23c tempest-GroupsTest-734701814 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1797732231 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1797732231, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:08:51 devstack cinder-volume[89331]: WARNING cinder.quota [None req-be63764c-fe9c-43f4-9c13-800f01aaf23c tempest-GroupsTest-734701814 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1797732231 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1797732231, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:08:51 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-be63764c-fe9c-43f4-9c13-800f01aaf23c tempest-GroupsTest-734701814 None] Created reservations ['63c0a853-cb4a-4649-aa7c-20d3df4677ab', 'bf814238-6565-48e9-95ce-3283681ca98f', 'eb9af84b-8f99-4ce0-86c5-384efde8c3a8', '499ed59b-4082-4e24-9015-fb88adbcbb07'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:08:51 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-485d0273-f2f1-4795-9174-ea4a6bc891a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.info" returned: 0 in 0.282s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-485d0273-f2f1-4795-9174-ea4a6bc891a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.530s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-be63764c-fe9c-43f4-9c13-800f01aaf23c tempest-GroupsTest-734701814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-be63764c-fe9c-43f4-9c13-800f01aaf23c tempest-GroupsTest-734701814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-be63764c-fe9c-43f4-9c13-800f01aaf23c tempest-GroupsTest-734701814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-be63764c-fe9c-43f4-9c13-800f01aaf23c tempest-GroupsTest-734701814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-be63764c-fe9c-43f4-9c13-800f01aaf23c tempest-GroupsTest-734701814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-be63764c-fe9c-43f4-9c13-800f01aaf23c tempest-GroupsTest-734701814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:51 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-485d0273-f2f1-4795-9174-ea4a6bc891a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Create snapshot completed successfully Sep 05 05:08:51 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:08:51 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:52 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-9a9b2465-5e39-4a62-b161-58825135dba0 tempest-GroupsTest-734701814 None] Created reservations ['14af47de-9c43-4380-a450-6e8b4591c6e5'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:08:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9a9b2465-5e39-4a62-b161-58825135dba0 tempest-GroupsTest-734701814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9a9b2465-5e39-4a62-b161-58825135dba0 tempest-GroupsTest-734701814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9a9b2465-5e39-4a62-b161-58825135dba0 tempest-GroupsTest-734701814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:52 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9a9b2465-5e39-4a62-b161-58825135dba0 tempest-GroupsTest-734701814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9a9b2465-5e39-4a62-b161-58825135dba0 tempest-GroupsTest-734701814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a9b2465-5e39-4a62-b161-58825135dba0 tempest-GroupsTest-734701814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-be63764c-fe9c-43f4-9c13-800f01aaf23c tempest-GroupsTest-734701814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.291s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:52 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-be63764c-fe9c-43f4-9c13-800f01aaf23c tempest-GroupsTest-734701814 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:08:52 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-be63764c-fe9c-43f4-9c13-800f01aaf23c tempest-GroupsTest-734701814 None] Delete group completed successfully. Sep 05 05:08:52 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:08:52 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:52 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a9b2465-5e39-4a62-b161-58825135dba0 tempest-GroupsTest-734701814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.325s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:52 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-9a9b2465-5e39-4a62-b161-58825135dba0 tempest-GroupsTest-734701814 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:08:52 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-9a9b2465-5e39-4a62-b161-58825135dba0 tempest-GroupsTest-734701814 None] Delete group completed successfully. Sep 05 05:08:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ea394710-09ea-4e7a-9335-f22620093510 tempest-BackendsCapabilitiesAdminTestsJSON-1643684801 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6874046325684, 'free_capacity_gb': 1773.6874046325684, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89331) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 05 05:08:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2144a814-8dbb-41f6-9167-5630e1803b73 tempest-BackendsCapabilitiesAdminTestsJSON-1643684801 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6874046325684, 'free_capacity_gb': 1773.6874046325684, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89331) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 05 05:08:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a18c7848-9f38-4553-83b2-43e7ef38c074 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Acquiring lock "cinder-685500ba-f786-46ef-87f3-a896488c0a6c-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a18c7848-9f38-4553-83b2-43e7ef38c074 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Lock "cinder-685500ba-f786-46ef-87f3-a896488c0a6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a18c7848-9f38-4553-83b2-43e7ef38c074 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Acquiring lock "cinder-quobyte-88782118-eb9f-41f1-abfe-4081505c5fd8" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:53 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a18c7848-9f38-4553-83b2-43e7ef38c074 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Lock "cinder-quobyte-88782118-eb9f-41f1-abfe-4081505c5fd8" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:53 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a18c7848-9f38-4553-83b2-43e7ef38c074 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Acquiring lock "cinder-quobyte-685500ba-f786-46ef-87f3-a896488c0a6c" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:53 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a18c7848-9f38-4553-83b2-43e7ef38c074 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Lock "cinder-quobyte-685500ba-f786-46ef-87f3-a896488c0a6c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-a18c7848-9f38-4553-83b2-43e7ef38c074 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Deleting offline snapshot 685500ba-f786-46ef-87f3-a896488c0a6c of volume 88782118-eb9f-41f1-abfe-4081505c5fd8 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:08:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-a18c7848-9f38-4553-83b2-43e7ef38c074 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] snapshot_file for this snap is: volume-88782118-eb9f-41f1-abfe-4081505c5fd8.685500ba-f786-46ef-87f3-a896488c0a6c {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:08:53 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b00eea1-2899-4acc-9376-9ec7e9bc487d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a18c7848-9f38-4553-83b2-43e7ef38c074 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.685500ba-f786-46ef-87f3-a896488c0a6c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:53 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.685500ba-f786-46ef-87f3-a896488c0a6c Sep 05 05:08:53 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:53 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a18c7848-9f38-4553-83b2-43e7ef38c074 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.685500ba-f786-46ef-87f3-a896488c0a6c" returned: 0 in 0.581s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-a18c7848-9f38-4553-83b2-43e7ef38c074 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88782118-eb9f-41f1-abfe-4081505c5fd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:08:53 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd02ea01-1499-481b-833f-ebdcab527ac9]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a18c7848-9f38-4553-83b2-43e7ef38c074 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:53 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8 Sep 05 05:08:53 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:54 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-c015c408-5a73-4ad7-acb8-ae262af11f20 tempest-GroupsTest-734701814 None] Group tempest-GroupsTest-Group-848060838: creating Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Flow 'volume_create_manager' (c17a5712-fd2a-42c4-ae02-fb4374549f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74cbac4c-7555-4ccd-8f92-55d679da4177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74cbac4c-7555-4ccd-8f92-55d679da4177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1502700753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f17c50a-4197-4f84-999f-6e91abb4a234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303ca6a7fdbf47bfb332f6fc2e9307e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:54Z,use_quota=True,user_id='2c05823ac01a4e4f9fb56aec9d3a1c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ceed497-c419-429d-ae93-dfca51a78292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ceed497-c419-429d-ae93-dfca51a78292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67aa1530-d59b-4e81-b5a9-637c5d5f782b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67aa1530-d59b-4e81-b5a9-637c5d5f782b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f17c50a-4197-4f84-999f-6e91abb4a234', 'volume_name': 'volume-6f17c50a-4197-4f84-999f-6e91abb4a234', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfae8a4e-18ea-4c95-97a3-9dbe072376d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfae8a4e-18ea-4c95-97a3-9dbe072376d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521f0baa-1c32-4a93-bbfa-d221852213cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:54 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Volume 6f17c50a-4197-4f84-999f-6e91abb4a234: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f17c50a-4197-4f84-999f-6e91abb4a234', 'volume_size': 1} Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1502700753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f17c50a-4197-4f84-999f-6e91abb4a234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303ca6a7fdbf47bfb332f6fc2e9307e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:54Z,use_quota=True,user_id='2c05823ac01a4e4f9fb56aec9d3a1c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Creating volume 6f17c50a-4197-4f84-999f-6e91abb4a234 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:08:54 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6f17c50a-4197-4f84-999f-6e91abb4a234 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:54 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a18c7848-9f38-4553-83b2-43e7ef38c074 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8" returned: 0 in 0.520s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a18c7848-9f38-4553-83b2-43e7ef38c074 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.685500ba-f786-46ef-87f3-a896488c0a6c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:54 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6f17c50a-4197-4f84-999f-6e91abb4a234 1073741824 Sep 05 05:08:54 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:54 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-c015c408-5a73-4ad7-acb8-ae262af11f20 tempest-GroupsTest-734701814 None] Group tempest-GroupsTest-Group-848060838: created successfully Sep 05 05:08:54 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-c015c408-5a73-4ad7-acb8-ae262af11f20 tempest-GroupsTest-734701814 None] Create group completed successfully. Sep 05 05:08:54 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.685500ba-f786-46ef-87f3-a896488c0a6c Sep 05 05:08:54 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:54 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a18c7848-9f38-4553-83b2-43e7ef38c074 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.685500ba-f786-46ef-87f3-a896488c0a6c" returned: 0 in 0.425s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a18c7848-9f38-4553-83b2-43e7ef38c074 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.685500ba-f786-46ef-87f3-a896488c0a6c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:54 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.685500ba-f786-46ef-87f3-a896488c0a6c Sep 05 05:08:54 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:54 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6f17c50a-4197-4f84-999f-6e91abb4a234 1073741824" returned: 0 in 0.498s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6f17c50a-4197-4f84-999f-6e91abb4a234 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:54 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6f17c50a-4197-4f84-999f-6e91abb4a234 Sep 05 05:08:54 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:54 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a18c7848-9f38-4553-83b2-43e7ef38c074 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8.685500ba-f786-46ef-87f3-a896488c0a6c" returned: 0 in 0.291s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a18c7848-9f38-4553-83b2-43e7ef38c074 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Lock "cinder-quobyte-685500ba-f786-46ef-87f3-a896488c0a6c" released by "_delete_snapshot" :: held 2.001s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a18c7848-9f38-4553-83b2-43e7ef38c074 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Lock "cinder-quobyte-88782118-eb9f-41f1-abfe-4081505c5fd8" released by "delete_snapshot" :: held 2.037s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:55 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6f17c50a-4197-4f84-999f-6e91abb4a234" returned: 0 in 0.360s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521f0baa-1c32-4a93-bbfa-d221852213cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f17c50a-4197-4f84-999f-6e91abb4a234', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8563c73-7038-4a1e-91e5-88065f14fb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:55 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Volume volume-6f17c50a-4197-4f84-999f-6e91abb4a234 (6f17c50a-4197-4f84-999f-6e91abb4a234): created successfully Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8563c73-7038-4a1e-91e5-88065f14fb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Flow 'volume_create_manager' (c17a5712-fd2a-42c4-ae02-fb4374549f92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:55 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-75b64e44-2a61-4100-ac07-4c2a21dfd780 tempest-VolumesListAdminTestJSON-1661602241 None] Created volume successfully. Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-a18c7848-9f38-4553-83b2-43e7ef38c074 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Created reservations ['743a3e61-a992-4143-92dd-c91b45adbae9', '41588b84-5313-4ea6-b352-c6654b92ef8f', '259daa71-9581-49e2-aeae-604304fbf160', 'a69ca825-6951-4fae-a8d1-749a935ee3be'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:08:55 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-a18c7848-9f38-4553-83b2-43e7ef38c074 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Delete snapshot completed successfully. Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a18c7848-9f38-4553-83b2-43e7ef38c074 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Lock "cinder-685500ba-f786-46ef-87f3-a896488c0a6c-delete_snapshot" released by "delete_snapshot" :: held 2.276s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Flow 'volume_create_manager' (cd1ad250-c5f8-4257-8735-24f08fa202a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84cdc4d-fca6-4f1a-85e3-a45bf26e340e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84cdc4d-fca6-4f1a-85e3-a45bf26e340e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2617137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3db3004-f536-4452-a0ce-208fc86d7010,host='devstack@QuobyteHD#QuobyteHD',id=e2a590de-9ef5-4c64-baec-4c2e90b0f89b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4200fd17fc3d495a93a917380ce7d625',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:56Z,use_quota=True,user_id='003c205ee909425e8d3124710010a675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ef7aeb8-b6b7-48c2-a8fd-43f406cbe903),volume_type_id=4ef7aeb8-b6b7-48c2-a8fd-43f406cbe903)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5f0a3d-d4a7-40cd-b8e1-6cd612cdb257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5f0a3d-d4a7-40cd-b8e1-6cd612cdb257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a56ed560-77b3-4f9e-abe2-83c1cdadb9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a56ed560-77b3-4f9e-abe2-83c1cdadb9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2a590de-9ef5-4c64-baec-4c2e90b0f89b', 'volume_name': 'volume-e2a590de-9ef5-4c64-baec-4c2e90b0f89b', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afee8d79-02e4-4c1a-a153-51f46c51c7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afee8d79-02e4-4c1a-a153-51f46c51c7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a90cb237-b989-4dd8-8bac-9aa024fcc29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:55 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Volume e2a590de-9ef5-4c64-baec-4c2e90b0f89b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2a590de-9ef5-4c64-baec-4c2e90b0f89b', 'volume_size': 1} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a3db3004-f536-4452-a0ce-208fc86d7010,created_at=2026-09-05T03:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2617137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3db3004-f536-4452-a0ce-208fc86d7010,host='devstack@QuobyteHD#QuobyteHD',id=e2a590de-9ef5-4c64-baec-4c2e90b0f89b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4200fd17fc3d495a93a917380ce7d625',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:56Z,use_quota=True,user_id='003c205ee909425e8d3124710010a675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ef7aeb8-b6b7-48c2-a8fd-43f406cbe903),volume_type_id=4ef7aeb8-b6b7-48c2-a8fd-43f406cbe903)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Creating volume e2a590de-9ef5-4c64-baec-4c2e90b0f89b {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:08:55 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:08:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e2a590de-9ef5-4c64-baec-4c2e90b0f89b 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:55 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e2a590de-9ef5-4c64-baec-4c2e90b0f89b 1073741824 Sep 05 05:08:55 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:56 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c84de849-c6eb-4d3c-8aae-90a996f5f266 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Acquiring lock "cinder-88782118-eb9f-41f1-abfe-4081505c5fd8-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e2a590de-9ef5-4c64-baec-4c2e90b0f89b 1073741824" returned: 0 in 0.599s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c84de849-c6eb-4d3c-8aae-90a996f5f266 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Lock "cinder-88782118-eb9f-41f1-abfe-4081505c5fd8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c84de849-c6eb-4d3c-8aae-90a996f5f266 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Acquiring lock "cinder-quobyte-88782118-eb9f-41f1-abfe-4081505c5fd8" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e2a590de-9ef5-4c64-baec-4c2e90b0f89b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c84de849-c6eb-4d3c-8aae-90a996f5f266 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Lock "cinder-quobyte-88782118-eb9f-41f1-abfe-4081505c5fd8" acquired by "delete_volume" :: waited 0.037s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:08:56 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e2a590de-9ef5-4c64-baec-4c2e90b0f89b Sep 05 05:08:56 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f8c839-6c35-4d59-8186-da0ad6efaa79]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c84de849-c6eb-4d3c-8aae-90a996f5f266 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:56 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8 Sep 05 05:08:56 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Flow 'volume_create_manager' (13a3f8e2-42ac-4340-b5d2-12a0c0e8b522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd12e8f5-8f82-4990-b293-c406614f63ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd12e8f5-8f82-4990-b293-c406614f63ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-795879061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c0f4db-f2d0-4b67-9c73-f6742b3de7d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303ca6a7fdbf47bfb332f6fc2e9307e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:57Z,use_quota=True,user_id='2c05823ac01a4e4f9fb56aec9d3a1c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f3e205-6760-403e-ac19-2a5a5040ff57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f3e205-6760-403e-ac19-2a5a5040ff57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:56 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f200c2d-d91c-46b6-bd8a-6bda8764cf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f200c2d-d91c-46b6-bd8a-6bda8764cf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11c0f4db-f2d0-4b67-9c73-f6742b3de7d4', 'volume_name': 'volume-11c0f4db-f2d0-4b67-9c73-f6742b3de7d4', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a231b458-31e2-4e5b-983a-e35c58bcea05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a231b458-31e2-4e5b-983a-e35c58bcea05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0296b838-5876-48cc-b6cc-9edfc66b0cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:56 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Volume 11c0f4db-f2d0-4b67-9c73-f6742b3de7d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11c0f4db-f2d0-4b67-9c73-f6742b3de7d4', 'volume_size': 1} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e2a590de-9ef5-4c64-baec-4c2e90b0f89b" returned: 0 in 0.434s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-795879061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c0f4db-f2d0-4b67-9c73-f6742b3de7d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303ca6a7fdbf47bfb332f6fc2e9307e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:57Z,use_quota=True,user_id='2c05823ac01a4e4f9fb56aec9d3a1c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Creating volume 11c0f4db-f2d0-4b67-9c73-f6742b3de7d4 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:08:56 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-11c0f4db-f2d0-4b67-9c73-f6742b3de7d4 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:56 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-11c0f4db-f2d0-4b67-9c73-f6742b3de7d4 1073741824 Sep 05 05:08:56 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a90cb237-b989-4dd8-8bac-9aa024fcc29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2a590de-9ef5-4c64-baec-4c2e90b0f89b', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29098d5b-1335-4394-820f-c04d2c0f7a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:56 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Volume volume-e2a590de-9ef5-4c64-baec-4c2e90b0f89b (e2a590de-9ef5-4c64-baec-4c2e90b0f89b): created successfully Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29098d5b-1335-4394-820f-c04d2c0f7a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Flow 'volume_create_manager' (cd1ad250-c5f8-4257-8735-24f08fa202a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:56 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-dbd7a2d8-b9f4-46e9-835a-28e33f0bf3de tempest-GroupsTest-734701814 None] Created volume successfully. Sep 05 05:08:56 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c84de849-c6eb-4d3c-8aae-90a996f5f266 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8" returned: 0 in 0.447s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c84de849-c6eb-4d3c-8aae-90a996f5f266 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:57 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8 Sep 05 05:08:57 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:57 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c84de849-c6eb-4d3c-8aae-90a996f5f266 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-88782118-eb9f-41f1-abfe-4081505c5fd8" returned: 0 in 0.272s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c84de849-c6eb-4d3c-8aae-90a996f5f266 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Lock "cinder-quobyte-88782118-eb9f-41f1-abfe-4081505c5fd8" released by "delete_volume" :: held 0.813s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:57 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-c84de849-c6eb-4d3c-8aae-90a996f5f266 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Created reservations ['8301ebad-aacc-454c-9bc9-022620744ebc', 'e62257c7-d327-4418-b776-3cf2bd9b9888', '4a677cc0-97b4-4338-868a-998285e4de4f', '8a13bd02-877e-4067-8bb6-0916161adb93'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:08:57 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-11c0f4db-f2d0-4b67-9c73-f6742b3de7d4 1073741824" returned: 0 in 0.510s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c84de849-c6eb-4d3c-8aae-90a996f5f266 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c84de849-c6eb-4d3c-8aae-90a996f5f266 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c84de849-c6eb-4d3c-8aae-90a996f5f266 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c84de849-c6eb-4d3c-8aae-90a996f5f266 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c84de849-c6eb-4d3c-8aae-90a996f5f266 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c84de849-c6eb-4d3c-8aae-90a996f5f266 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:57 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:08:57 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-11c0f4db-f2d0-4b67-9c73-f6742b3de7d4 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:57 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-11c0f4db-f2d0-4b67-9c73-f6742b3de7d4 Sep 05 05:08:57 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:57 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c84de849-c6eb-4d3c-8aae-90a996f5f266 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.311s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:57 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-c84de849-c6eb-4d3c-8aae-90a996f5f266 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:08:57 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-c84de849-c6eb-4d3c-8aae-90a996f5f266 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Deleted volume successfully. Sep 05 05:08:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c84de849-c6eb-4d3c-8aae-90a996f5f266 tempest-VolumeSnapshotQuotasNegativeTestJSON-717695658 None] Lock "cinder-88782118-eb9f-41f1-abfe-4081505c5fd8-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:08:57 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-11c0f4db-f2d0-4b67-9c73-f6742b3de7d4" returned: 0 in 0.348s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:08:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0296b838-5876-48cc-b6cc-9edfc66b0cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11c0f4db-f2d0-4b67-9c73-f6742b3de7d4', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f780386-f43f-4b1f-9348-91973b8c248d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:57 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Volume volume-11c0f4db-f2d0-4b67-9c73-f6742b3de7d4 (11c0f4db-f2d0-4b67-9c73-f6742b3de7d4): created successfully Sep 05 05:08:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f780386-f43f-4b1f-9348-91973b8c248d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Flow 'volume_create_manager' (13a3f8e2-42ac-4340-b5d2-12a0c0e8b522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:57 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-0287d2ee-faeb-4ac6-881d-1836d753783f tempest-VolumesListAdminTestJSON-1661602241 None] Created volume successfully. Sep 05 05:08:58 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:08:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Flow 'volume_create_manager' (9d0629ec-2082-4ea8-bc1d-3d5a6eef1928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a0f1a17-9237-41c1-91a0-af34c5916c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a0f1a17-9237-41c1-91a0-af34c5916c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1826306525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3db3004-f536-4452-a0ce-208fc86d7010,host='devstack@QuobyteHD#QuobyteHD',id=9d9c8e75-3f64-4afb-a3c3-dc658402243d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4200fd17fc3d495a93a917380ce7d625',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:59Z,use_quota=True,user_id='003c205ee909425e8d3124710010a675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ef7aeb8-b6b7-48c2-a8fd-43f406cbe903),volume_type_id=4ef7aeb8-b6b7-48c2-a8fd-43f406cbe903)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0afe8f9-f3f4-403b-a3ed-e59f9d004eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0afe8f9-f3f4-403b-a3ed-e59f9d004eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bda5a33-13d3-4cc2-811f-7d250344f8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bda5a33-13d3-4cc2-811f-7d250344f8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d9c8e75-3f64-4afb-a3c3-dc658402243d', 'volume_name': 'volume-9d9c8e75-3f64-4afb-a3c3-dc658402243d', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb48292-2a35-45fa-8768-3f25c301ab43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb48292-2a35-45fa-8768-3f25c301ab43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d1cdfa-e9c1-4604-8183-fb614665fc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:58 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Volume 9d9c8e75-3f64-4afb-a3c3-dc658402243d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d9c8e75-3f64-4afb-a3c3-dc658402243d', 'volume_size': 1} Sep 05 05:08:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a3db3004-f536-4452-a0ce-208fc86d7010,created_at=2026-09-05T03:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1826306525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3db3004-f536-4452-a0ce-208fc86d7010,host='devstack@QuobyteHD#QuobyteHD',id=9d9c8e75-3f64-4afb-a3c3-dc658402243d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4200fd17fc3d495a93a917380ce7d625',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:59Z,use_quota=True,user_id='003c205ee909425e8d3124710010a675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ef7aeb8-b6b7-48c2-a8fd-43f406cbe903),volume_type_id=4ef7aeb8-b6b7-48c2-a8fd-43f406cbe903)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:08:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Creating volume 9d9c8e75-3f64-4afb-a3c3-dc658402243d {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:08:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:08:58 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:08:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9d9c8e75-3f64-4afb-a3c3-dc658402243d 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:58 devstack sudo[98443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9d9c8e75-3f64-4afb-a3c3-dc658402243d 1073741824 Sep 05 05:08:58 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:59 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9d9c8e75-3f64-4afb-a3c3-dc658402243d 1073741824" returned: 0 in 0.624s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9d9c8e75-3f64-4afb-a3c3-dc658402243d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:59 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9d9c8e75-3f64-4afb-a3c3-dc658402243d Sep 05 05:08:59 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Flow 'volume_create_manager' (2c1e2419-e018-40ed-9dc3-979f0065075b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e33c69-5d73-4e68-9ec6-d7ef9ef41a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e33c69-5d73-4e68-9ec6-d7ef9ef41a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1790765801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bcacf57-d997-45bb-81d2-8e59e6a69c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303ca6a7fdbf47bfb332f6fc2e9307e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:59Z,use_quota=True,user_id='2c05823ac01a4e4f9fb56aec9d3a1c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c49260-e301-4a2a-acd0-214be1eb4fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c49260-e301-4a2a-acd0-214be1eb4fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9100b0b-540d-4e58-a0de-7621e1b8f845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9100b0b-540d-4e58-a0de-7621e1b8f845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bcacf57-d997-45bb-81d2-8e59e6a69c21', 'volume_name': 'volume-2bcacf57-d997-45bb-81d2-8e59e6a69c21', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0639cf-2e64-49af-bec3-58a7c606dd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0639cf-2e64-49af-bec3-58a7c606dd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a2cb61-94ac-480c-a788-3ecb8d4f6f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:59 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Volume 2bcacf57-d997-45bb-81d2-8e59e6a69c21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bcacf57-d997-45bb-81d2-8e59e6a69c21', 'volume_size': 1} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:59 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9d9c8e75-3f64-4afb-a3c3-dc658402243d" returned: 0 in 0.282s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.104s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1790765801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bcacf57-d997-45bb-81d2-8e59e6a69c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303ca6a7fdbf47bfb332f6fc2e9307e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:08:59Z,use_quota=True,user_id='2c05823ac01a4e4f9fb56aec9d3a1c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Creating volume 2bcacf57-d997-45bb-81d2-8e59e6a69c21 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:08:59 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bcacf57-d997-45bb-81d2-8e59e6a69c21 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d1cdfa-e9c1-4604-8183-fb614665fc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d9c8e75-3f64-4afb-a3c3-dc658402243d', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:59 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bcacf57-d997-45bb-81d2-8e59e6a69c21 1073741824 Sep 05 05:08:59 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9749ad6-26fa-48f2-837d-18e74063e0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:08:59 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Volume volume-9d9c8e75-3f64-4afb-a3c3-dc658402243d (9d9c8e75-3f64-4afb-a3c3-dc658402243d): created successfully Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9749ad6-26fa-48f2-837d-18e74063e0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:08:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Flow 'volume_create_manager' (9d0629ec-2082-4ea8-bc1d-3d5a6eef1928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:08:59 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-e7ee871c-fc36-4619-8077-65dcd53489c9 tempest-GroupsTest-734701814 None] Created volume successfully. Sep 05 05:09:00 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bcacf57-d997-45bb-81d2-8e59e6a69c21 1073741824" returned: 0 in 0.586s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bcacf57-d997-45bb-81d2-8e59e6a69c21 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:00 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bcacf57-d997-45bb-81d2-8e59e6a69c21 Sep 05 05:09:00 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:00 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bcacf57-d997-45bb-81d2-8e59e6a69c21" returned: 0 in 0.283s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:00 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:09:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:00 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a2cb61-94ac-480c-a788-3ecb8d4f6f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bcacf57-d997-45bb-81d2-8e59e6a69c21', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:00 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697919d0-df72-4cef-96ca-5e4262bed81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:00 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Volume volume-2bcacf57-d997-45bb-81d2-8e59e6a69c21 (2bcacf57-d997-45bb-81d2-8e59e6a69c21): created successfully Sep 05 05:09:00 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697919d0-df72-4cef-96ca-5e4262bed81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:00 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Flow 'volume_create_manager' (2c1e2419-e018-40ed-9dc3-979f0065075b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:00 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-db827fff-9393-4933-aa56-265907b088c4 tempest-VolumesListAdminTestJSON-1661602241 None] Created volume successfully. Sep 05 05:09:01 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-a847ce83-ec76-4bf1-84ed-5260aa11c97a tempest-GroupsTest-734701814 None] Update group completed successfully. Sep 05 05:09:02 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:09:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Flow 'volume_create_manager' (f4d770b4-b4dc-4089-b224-238bce498edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a42dbd-9e9c-4029-924a-dfc81a95ffdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a42dbd-9e9c-4029-924a-dfc81a95ffdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63dad4eb-e026-4807-8820-ba4d5dfa417d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b357eb1dfb5a40b79cd459a856ca34b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:03Z,use_quota=True,user_id='3ae62634e70049c986059143b4618f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5efbf0cc-570a-434c-bd9f-5c03b4c06d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5efbf0cc-570a-434c-bd9f-5c03b4c06d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6092811d-9b29-4fad-8dc7-e54f22cdb840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6092811d-9b29-4fad-8dc7-e54f22cdb840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63dad4eb-e026-4807-8820-ba4d5dfa417d', 'volume_name': 'volume-63dad4eb-e026-4807-8820-ba4d5dfa417d', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba06acb-fe9f-49ce-96bf-defe257c5fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba06acb-fe9f-49ce-96bf-defe257c5fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (230cd985-9874-4b6d-a520-1d2e0d4ae2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:02 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Volume 63dad4eb-e026-4807-8820-ba4d5dfa417d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63dad4eb-e026-4807-8820-ba4d5dfa417d', 'volume_size': 1} Sep 05 05:09:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63dad4eb-e026-4807-8820-ba4d5dfa417d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b357eb1dfb5a40b79cd459a856ca34b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:03Z,use_quota=True,user_id='3ae62634e70049c986059143b4618f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:09:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Creating volume 63dad4eb-e026-4807-8820-ba4d5dfa417d {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:09:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:09:02 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:09:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63dad4eb-e026-4807-8820-ba4d5dfa417d 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:02 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63dad4eb-e026-4807-8820-ba4d5dfa417d 1073741824 Sep 05 05:09:02 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:02 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-de0cf481-d2a6-4af0-8283-c5e5a862f2e5 tempest-GroupsTest-734701814 None] Update group completed successfully. Sep 05 05:09:03 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63dad4eb-e026-4807-8820-ba4d5dfa417d 1073741824" returned: 0 in 0.506s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63dad4eb-e026-4807-8820-ba4d5dfa417d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:03 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63dad4eb-e026-4807-8820-ba4d5dfa417d Sep 05 05:09:03 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:03 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63dad4eb-e026-4807-8820-ba4d5dfa417d" returned: 0 in 0.287s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:09:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (230cd985-9874-4b6d-a520-1d2e0d4ae2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63dad4eb-e026-4807-8820-ba4d5dfa417d', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec2e458-70df-4879-b068-9ea2ed943ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:03 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Volume volume-63dad4eb-e026-4807-8820-ba4d5dfa417d (63dad4eb-e026-4807-8820-ba4d5dfa417d): created successfully Sep 05 05:09:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec2e458-70df-4879-b068-9ea2ed943ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Flow 'volume_create_manager' (f4d770b4-b4dc-4089-b224-238bce498edb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:03 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-8e651950-32a4-4adb-97f5-105ff2ef1089 tempest-VolumesListAdminTestJSON-1855002609 None] Created volume successfully. Sep 05 05:09:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] Acquiring lock "cinder-quobyte-9d9c8e75-3f64-4afb-a3c3-dc658402243d" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] Lock "cinder-quobyte-9d9c8e75-3f64-4afb-a3c3-dc658402243d" acquired by "delete_volume" :: waited 0.029s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:04 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecd9c09-ed3b-4cbe-9265-7fbf68d9d4b2]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9d9c8e75-3f64-4afb-a3c3-dc658402243d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:04 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9d9c8e75-3f64-4afb-a3c3-dc658402243d Sep 05 05:09:04 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ad7df8bf-f25f-4f0c-9ba1-bba156dada55 tempest-VolumesListAdminTestJSON-1855002609 None] Acquiring lock "cinder-63dad4eb-e026-4807-8820-ba4d5dfa417d-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ad7df8bf-f25f-4f0c-9ba1-bba156dada55 tempest-VolumesListAdminTestJSON-1855002609 None] Lock "cinder-63dad4eb-e026-4807-8820-ba4d5dfa417d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ad7df8bf-f25f-4f0c-9ba1-bba156dada55 tempest-VolumesListAdminTestJSON-1855002609 None] Acquiring lock "cinder-quobyte-63dad4eb-e026-4807-8820-ba4d5dfa417d" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ad7df8bf-f25f-4f0c-9ba1-bba156dada55 tempest-VolumesListAdminTestJSON-1855002609 None] Lock "cinder-quobyte-63dad4eb-e026-4807-8820-ba4d5dfa417d" acquired by "delete_volume" :: waited 0.031s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81936c8-1a59-443d-a3f7-a88c330fe0c7]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ad7df8bf-f25f-4f0c-9ba1-bba156dada55 tempest-VolumesListAdminTestJSON-1855002609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63dad4eb-e026-4807-8820-ba4d5dfa417d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4ea5c2c8-8d8b-4a8b-b430-b73524fd0add tempest-VolumesListAdminTestJSON-1661602241 None] Acquiring lock "cinder-2bcacf57-d997-45bb-81d2-8e59e6a69c21-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4ea5c2c8-8d8b-4a8b-b430-b73524fd0add tempest-VolumesListAdminTestJSON-1661602241 None] Lock "cinder-2bcacf57-d997-45bb-81d2-8e59e6a69c21-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:05 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9d9c8e75-3f64-4afb-a3c3-dc658402243d" returned: 0 in 0.593s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9d9c8e75-3f64-4afb-a3c3-dc658402243d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:05 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9d9c8e75-3f64-4afb-a3c3-dc658402243d Sep 05 05:09:05 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4ea5c2c8-8d8b-4a8b-b430-b73524fd0add tempest-VolumesListAdminTestJSON-1661602241 None] Acquiring lock "cinder-quobyte-2bcacf57-d997-45bb-81d2-8e59e6a69c21" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:05 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63dad4eb-e026-4807-8820-ba4d5dfa417d Sep 05 05:09:05 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4ea5c2c8-8d8b-4a8b-b430-b73524fd0add tempest-VolumesListAdminTestJSON-1661602241 None] Lock "cinder-quobyte-2bcacf57-d997-45bb-81d2-8e59e6a69c21" acquired by "delete_volume" :: waited 0.028s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0bb0a1-cef1-46c6-9341-3bd11621d946]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4ea5c2c8-8d8b-4a8b-b430-b73524fd0add tempest-VolumesListAdminTestJSON-1661602241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bcacf57-d997-45bb-81d2-8e59e6a69c21 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:05 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bcacf57-d997-45bb-81d2-8e59e6a69c21 Sep 05 05:09:05 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Flow 'volume_create_manager' (bbfd1ffd-e010-4a11-843a-14a54163c3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9eac3e7-e500-4a87-a0e3-1763cebf3b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9eac3e7-e500-4a87-a0e3-1763cebf3b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1175577737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ddf57d-3347-4cb2-9c19-5245da538cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a864876a8a4838af8e2d55e00bd890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:05Z,use_quota=True,user_id='ffad838ba7634c6ab00b037f65b30342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7848a36c-f705-449f-a06a-466aedeb1714),volume_type_id=7848a36c-f705-449f-a06a-466aedeb1714)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b352d3b-31ed-4abc-90b4-e78c0c3a36a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b352d3b-31ed-4abc-90b4-e78c0c3a36a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce82d288-3db6-43e6-8451-2afe1771e566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce82d288-3db6-43e6-8451-2afe1771e566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55ddf57d-3347-4cb2-9c19-5245da538cd1', 'volume_name': 'volume-55ddf57d-3347-4cb2-9c19-5245da538cd1', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b50638-cfda-433e-a644-58c8ba1d7e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b50638-cfda-433e-a644-58c8ba1d7e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68ca63e-cd80-494c-919a-2b3d9a6a5bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:05 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Volume 55ddf57d-3347-4cb2-9c19-5245da538cd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55ddf57d-3347-4cb2-9c19-5245da538cd1', 'volume_size': 1} Sep 05 05:09:05 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1175577737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ddf57d-3347-4cb2-9c19-5245da538cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a864876a8a4838af8e2d55e00bd890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:05Z,use_quota=True,user_id='ffad838ba7634c6ab00b037f65b30342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7848a36c-f705-449f-a06a-466aedeb1714),volume_type_id=7848a36c-f705-449f-a06a-466aedeb1714)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Creating volume 55ddf57d-3347-4cb2-9c19-5245da538cd1 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:05 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:09:05 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-55ddf57d-3347-4cb2-9c19-5245da538cd1 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9d9c8e75-3f64-4afb-a3c3-dc658402243d" returned: 0 in 0.472s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ad7df8bf-f25f-4f0c-9ba1-bba156dada55 tempest-VolumesListAdminTestJSON-1855002609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63dad4eb-e026-4807-8820-ba4d5dfa417d" returned: 0 in 0.589s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ad7df8bf-f25f-4f0c-9ba1-bba156dada55 tempest-VolumesListAdminTestJSON-1855002609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63dad4eb-e026-4807-8820-ba4d5dfa417d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:05 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-55ddf57d-3347-4cb2-9c19-5245da538cd1 1073741824 Sep 05 05:09:05 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] Lock "cinder-quobyte-9d9c8e75-3f64-4afb-a3c3-dc658402243d" released by "delete_volume" :: held 1.136s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] Acquiring lock "cinder-quobyte-e2a590de-9ef5-4c64-baec-4c2e90b0f89b" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] Lock "cinder-quobyte-e2a590de-9ef5-4c64-baec-4c2e90b0f89b" acquired by "delete_volume" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:05 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63dad4eb-e026-4807-8820-ba4d5dfa417d Sep 05 05:09:05 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2efd66-88d7-474a-bec5-96020db999e9]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e2a590de-9ef5-4c64-baec-4c2e90b0f89b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:05 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4ea5c2c8-8d8b-4a8b-b430-b73524fd0add tempest-VolumesListAdminTestJSON-1661602241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bcacf57-d997-45bb-81d2-8e59e6a69c21" returned: 0 in 0.544s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4ea5c2c8-8d8b-4a8b-b430-b73524fd0add tempest-VolumesListAdminTestJSON-1661602241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bcacf57-d997-45bb-81d2-8e59e6a69c21 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:05 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e2a590de-9ef5-4c64-baec-4c2e90b0f89b Sep 05 05:09:05 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:05 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bcacf57-d997-45bb-81d2-8e59e6a69c21 Sep 05 05:09:05 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:06 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ad7df8bf-f25f-4f0c-9ba1-bba156dada55 tempest-VolumesListAdminTestJSON-1855002609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63dad4eb-e026-4807-8820-ba4d5dfa417d" returned: 0 in 0.382s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ad7df8bf-f25f-4f0c-9ba1-bba156dada55 tempest-VolumesListAdminTestJSON-1855002609 None] Lock "cinder-quobyte-63dad4eb-e026-4807-8820-ba4d5dfa417d" released by "delete_volume" :: held 1.046s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-ad7df8bf-f25f-4f0c-9ba1-bba156dada55 tempest-VolumesListAdminTestJSON-1855002609 None] Created reservations ['20717bf0-7918-41ac-9f63-a26f738d33e2', 'cbc8869e-8737-4fc7-a44d-a10d587540bc', 'c5d0e068-8270-4678-b58b-2f8534d03983', 'a71201f4-9bc9-480b-ac37-4029e280a6b8'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ad7df8bf-f25f-4f0c-9ba1-bba156dada55 tempest-VolumesListAdminTestJSON-1855002609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ad7df8bf-f25f-4f0c-9ba1-bba156dada55 tempest-VolumesListAdminTestJSON-1855002609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ad7df8bf-f25f-4f0c-9ba1-bba156dada55 tempest-VolumesListAdminTestJSON-1855002609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ad7df8bf-f25f-4f0c-9ba1-bba156dada55 tempest-VolumesListAdminTestJSON-1855002609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ad7df8bf-f25f-4f0c-9ba1-bba156dada55 tempest-VolumesListAdminTestJSON-1855002609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ad7df8bf-f25f-4f0c-9ba1-bba156dada55 tempest-VolumesListAdminTestJSON-1855002609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:06 devstack sudo[98505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:09:06 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:06 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e2a590de-9ef5-4c64-baec-4c2e90b0f89b" returned: 0 in 0.595s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e2a590de-9ef5-4c64-baec-4c2e90b0f89b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:06 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4ea5c2c8-8d8b-4a8b-b430-b73524fd0add tempest-VolumesListAdminTestJSON-1661602241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bcacf57-d997-45bb-81d2-8e59e6a69c21" returned: 0 in 0.493s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:06 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-55ddf57d-3347-4cb2-9c19-5245da538cd1 1073741824" returned: 0 in 0.743s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4ea5c2c8-8d8b-4a8b-b430-b73524fd0add tempest-VolumesListAdminTestJSON-1661602241 None] Lock "cinder-quobyte-2bcacf57-d997-45bb-81d2-8e59e6a69c21" released by "delete_volume" :: held 1.124s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:06 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e2a590de-9ef5-4c64-baec-4c2e90b0f89b Sep 05 05:09:06 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-55ddf57d-3347-4cb2-9c19-5245da538cd1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:06 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-55ddf57d-3347-4cb2-9c19-5245da538cd1 Sep 05 05:09:06 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-4ea5c2c8-8d8b-4a8b-b430-b73524fd0add tempest-VolumesListAdminTestJSON-1661602241 None] Created reservations ['6df120f9-c953-42ef-b1da-4c305d81f6ea', '23664e32-12f9-4c8e-a9de-8e8125844aa3', 'd0494906-0d1f-40b2-810b-3e661794ad0d', 'ee496965-3c31-4fd2-a176-d7eced39ee1d'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4ea5c2c8-8d8b-4a8b-b430-b73524fd0add tempest-VolumesListAdminTestJSON-1661602241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4ea5c2c8-8d8b-4a8b-b430-b73524fd0add tempest-VolumesListAdminTestJSON-1661602241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4ea5c2c8-8d8b-4a8b-b430-b73524fd0add tempest-VolumesListAdminTestJSON-1661602241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4ea5c2c8-8d8b-4a8b-b430-b73524fd0add tempest-VolumesListAdminTestJSON-1661602241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4ea5c2c8-8d8b-4a8b-b430-b73524fd0add tempest-VolumesListAdminTestJSON-1661602241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4ea5c2c8-8d8b-4a8b-b430-b73524fd0add tempest-VolumesListAdminTestJSON-1661602241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:06 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:09:06 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:06 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ad7df8bf-f25f-4f0c-9ba1-bba156dada55 tempest-VolumesListAdminTestJSON-1855002609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.383s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-ad7df8bf-f25f-4f0c-9ba1-bba156dada55 tempest-VolumesListAdminTestJSON-1855002609 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:09:06 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ad7df8bf-f25f-4f0c-9ba1-bba156dada55 tempest-VolumesListAdminTestJSON-1855002609 None] Deleted volume successfully. Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ad7df8bf-f25f-4f0c-9ba1-bba156dada55 tempest-VolumesListAdminTestJSON-1855002609 None] Lock "cinder-63dad4eb-e026-4807-8820-ba4d5dfa417d-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:06 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e2a590de-9ef5-4c64-baec-4c2e90b0f89b" returned: 0 in 0.426s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:06 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-55ddf57d-3347-4cb2-9c19-5245da538cd1" returned: 0 in 0.336s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] Lock "cinder-quobyte-e2a590de-9ef5-4c64-baec-4c2e90b0f89b" released by "delete_volume" :: held 1.084s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68ca63e-cd80-494c-919a-2b3d9a6a5bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55ddf57d-3347-4cb2-9c19-5245da538cd1', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e2efd7-ac6d-4e02-a07b-f25ab202baa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:06 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Volume volume-55ddf57d-3347-4cb2-9c19-5245da538cd1 (55ddf57d-3347-4cb2-9c19-5245da538cd1): created successfully Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e2efd7-ac6d-4e02-a07b-f25ab202baa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Flow 'volume_create_manager' (bbfd1ffd-e010-4a11-843a-14a54163c3f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:06 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-00e33a4f-c716-40a2-8473-f2c68721b81f tempest-VolumeTypesAccessTest-1813446070 None] Created volume successfully. Sep 05 05:09:06 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4ea5c2c8-8d8b-4a8b-b430-b73524fd0add tempest-VolumesListAdminTestJSON-1661602241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.301s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-4ea5c2c8-8d8b-4a8b-b430-b73524fd0add tempest-VolumesListAdminTestJSON-1661602241 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] Created reservations ['3b239112-fb8c-4ae3-b126-732279d13891'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:09:06 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-4ea5c2c8-8d8b-4a8b-b430-b73524fd0add tempest-VolumesListAdminTestJSON-1661602241 None] Deleted volume successfully. Sep 05 05:09:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4ea5c2c8-8d8b-4a8b-b430-b73524fd0add tempest-VolumesListAdminTestJSON-1661602241 None] Lock "cinder-2bcacf57-d997-45bb-81d2-8e59e6a69c21-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:06 devstack cinder-volume[89331]: WARNING cinder.quota [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1000388795 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1000388795, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:09:06 devstack cinder-volume[89331]: WARNING cinder.quota [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1000388795 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1000388795, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:09:07 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] Created reservations ['2b950d04-f184-4019-af33-33bedf811586', 'df45b096-cbfb-44d8-b2b2-020db4192ec2', '38a4227a-8d27-472d-88ca-9fa41f02b82f', 'a59f846a-196e-491f-9434-57f63bb345b6'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:09:07 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] Created reservations ['0894f9f3-be9b-4bf9-84c8-2637c58e79a4', '5e15df82-b0ab-4946-b32b-71e6f22e5015', 'cffe3360-8dfc-4b31-8fc0-1a1039fb3160', 'b41b2f15-5391-44c5-91e6-2c3d02fa4ad2'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:09:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:07 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:09:07 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:07 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.272s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:07 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:09:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3c90deef-6095-4164-8439-7cc8fa6af8b3 tempest-VolumesListAdminTestJSON-1661602241 None] Acquiring lock "cinder-11c0f4db-f2d0-4b67-9c73-f6742b3de7d4-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:07 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-86d9ddd1-c270-462f-a67c-51574eca795c tempest-GroupsTest-734701814 None] Delete group completed successfully. Sep 05 05:09:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3c90deef-6095-4164-8439-7cc8fa6af8b3 tempest-VolumesListAdminTestJSON-1661602241 None] Lock "cinder-11c0f4db-f2d0-4b67-9c73-f6742b3de7d4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3c90deef-6095-4164-8439-7cc8fa6af8b3 tempest-VolumesListAdminTestJSON-1661602241 None] Acquiring lock "cinder-quobyte-11c0f4db-f2d0-4b67-9c73-f6742b3de7d4" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3c90deef-6095-4164-8439-7cc8fa6af8b3 tempest-VolumesListAdminTestJSON-1661602241 None] Lock "cinder-quobyte-11c0f4db-f2d0-4b67-9c73-f6742b3de7d4" acquired by "delete_volume" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:07 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee5fdb9-f44e-4f50-ac2d-29b14caf128e]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3c90deef-6095-4164-8439-7cc8fa6af8b3 tempest-VolumesListAdminTestJSON-1661602241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-11c0f4db-f2d0-4b67-9c73-f6742b3de7d4 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:07 devstack sudo[98520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-11c0f4db-f2d0-4b67-9c73-f6742b3de7d4 Sep 05 05:09:07 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-50c523e1-7fb3-4122-ab5a-746d1b7d58cd tempest-VolumeTypesAccessTest-1813446070 None] Acquiring lock "cinder-55ddf57d-3347-4cb2-9c19-5245da538cd1-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-50c523e1-7fb3-4122-ab5a-746d1b7d58cd tempest-VolumeTypesAccessTest-1813446070 None] Lock "cinder-55ddf57d-3347-4cb2-9c19-5245da538cd1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-50c523e1-7fb3-4122-ab5a-746d1b7d58cd tempest-VolumeTypesAccessTest-1813446070 None] Acquiring lock "cinder-quobyte-55ddf57d-3347-4cb2-9c19-5245da538cd1" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-50c523e1-7fb3-4122-ab5a-746d1b7d58cd tempest-VolumeTypesAccessTest-1813446070 None] Lock "cinder-quobyte-55ddf57d-3347-4cb2-9c19-5245da538cd1" acquired by "delete_volume" :: waited 0.016s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:07 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfefff0-dc84-48aa-ade8-3e6942557a92]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-50c523e1-7fb3-4122-ab5a-746d1b7d58cd tempest-VolumeTypesAccessTest-1813446070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-55ddf57d-3347-4cb2-9c19-5245da538cd1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:08 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-55ddf57d-3347-4cb2-9c19-5245da538cd1 Sep 05 05:09:08 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:08 devstack sudo[98520]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3c90deef-6095-4164-8439-7cc8fa6af8b3 tempest-VolumesListAdminTestJSON-1661602241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-11c0f4db-f2d0-4b67-9c73-f6742b3de7d4" returned: 0 in 0.453s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3c90deef-6095-4164-8439-7cc8fa6af8b3 tempest-VolumesListAdminTestJSON-1661602241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-11c0f4db-f2d0-4b67-9c73-f6742b3de7d4 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:08 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-11c0f4db-f2d0-4b67-9c73-f6742b3de7d4 Sep 05 05:09:08 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Flow 'volume_create_manager' (dff4b447-8df9-4eca-a0bb-1822cec04f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e11871-edb0-4935-b732-66215b56fd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e11871-edb0-4935-b732-66215b56fd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1429630569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5047ae9-ea24-409e-8077-1965605a552d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='156e05fb3a06470c839e0cdd6ef9506c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:08Z,use_quota=True,user_id='2c014bab305744a894fa8ba438d45bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(331630ae-1370-4e8c-a501-e9848bc8c5d1),volume_type_id=331630ae-1370-4e8c-a501-e9848bc8c5d1)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a345b056-454d-4c9c-9561-adcc35ea36c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a345b056-454d-4c9c-9561-adcc35ea36c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d765fed-a7b1-49c6-ae0e-3d1f1de219b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d765fed-a7b1-49c6-ae0e-3d1f1de219b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5047ae9-ea24-409e-8077-1965605a552d', 'volume_name': 'volume-c5047ae9-ea24-409e-8077-1965605a552d', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdace559-a17f-47a6-b3e1-51ef6d3f73ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdace559-a17f-47a6-b3e1-51ef6d3f73ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be0961d-1d74-46c2-94b5-1ca3c6654180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:08 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Volume c5047ae9-ea24-409e-8077-1965605a552d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5047ae9-ea24-409e-8077-1965605a552d', 'volume_size': 1} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1429630569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5047ae9-ea24-409e-8077-1965605a552d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='156e05fb3a06470c839e0cdd6ef9506c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:08Z,use_quota=True,user_id='2c014bab305744a894fa8ba438d45bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(331630ae-1370-4e8c-a501-e9848bc8c5d1),volume_type_id=331630ae-1370-4e8c-a501-e9848bc8c5d1)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Creating volume c5047ae9-ea24-409e-8077-1965605a552d {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:09:08 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c5047ae9-ea24-409e-8077-1965605a552d 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:08 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-50c523e1-7fb3-4122-ab5a-746d1b7d58cd tempest-VolumeTypesAccessTest-1813446070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-55ddf57d-3347-4cb2-9c19-5245da538cd1" returned: 0 in 0.427s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-50c523e1-7fb3-4122-ab5a-746d1b7d58cd tempest-VolumeTypesAccessTest-1813446070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-55ddf57d-3347-4cb2-9c19-5245da538cd1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:08 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c5047ae9-ea24-409e-8077-1965605a552d 1073741824 Sep 05 05:09:08 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:08 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-55ddf57d-3347-4cb2-9c19-5245da538cd1 Sep 05 05:09:08 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:08 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3c90deef-6095-4164-8439-7cc8fa6af8b3 tempest-VolumesListAdminTestJSON-1661602241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-11c0f4db-f2d0-4b67-9c73-f6742b3de7d4" returned: 0 in 0.311s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3c90deef-6095-4164-8439-7cc8fa6af8b3 tempest-VolumesListAdminTestJSON-1661602241 None] Lock "cinder-quobyte-11c0f4db-f2d0-4b67-9c73-f6742b3de7d4" released by "delete_volume" :: held 0.811s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-3c90deef-6095-4164-8439-7cc8fa6af8b3 tempest-VolumesListAdminTestJSON-1661602241 None] Created reservations ['16a15f68-93f2-44b5-aa95-821bcf3d9ae0', 'c1eed82d-9302-4052-a074-f9ec273a29d3', '9f68d983-43e5-4ae1-b887-e7536e9a1b09', '0602e44a-4803-4e89-98b4-a0d985a2f2f5'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3c90deef-6095-4164-8439-7cc8fa6af8b3 tempest-VolumesListAdminTestJSON-1661602241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3c90deef-6095-4164-8439-7cc8fa6af8b3 tempest-VolumesListAdminTestJSON-1661602241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3c90deef-6095-4164-8439-7cc8fa6af8b3 tempest-VolumesListAdminTestJSON-1661602241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3c90deef-6095-4164-8439-7cc8fa6af8b3 tempest-VolumesListAdminTestJSON-1661602241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3c90deef-6095-4164-8439-7cc8fa6af8b3 tempest-VolumesListAdminTestJSON-1661602241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3c90deef-6095-4164-8439-7cc8fa6af8b3 tempest-VolumesListAdminTestJSON-1661602241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:08 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:09:08 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:08 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-50c523e1-7fb3-4122-ab5a-746d1b7d58cd tempest-VolumeTypesAccessTest-1813446070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-55ddf57d-3347-4cb2-9c19-5245da538cd1" returned: 0 in 0.338s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-50c523e1-7fb3-4122-ab5a-746d1b7d58cd tempest-VolumeTypesAccessTest-1813446070 None] Lock "cinder-quobyte-55ddf57d-3347-4cb2-9c19-5245da538cd1" released by "delete_volume" :: held 0.815s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:08 devstack cinder-volume[89331]: WARNING cinder.quota [None req-50c523e1-7fb3-4122-ab5a-746d1b7d58cd tempest-VolumeTypesAccessTest-1813446070 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1832791728 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1832791728, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:09:08 devstack cinder-volume[89331]: WARNING cinder.quota [None req-50c523e1-7fb3-4122-ab5a-746d1b7d58cd tempest-VolumeTypesAccessTest-1813446070 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1832791728 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1832791728, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-50c523e1-7fb3-4122-ab5a-746d1b7d58cd tempest-VolumeTypesAccessTest-1813446070 None] Created reservations ['178a2959-a34f-453c-8598-b837bd3eec7d', 'e36c5d99-16a8-4cfc-92e1-288de581749e', 'b6ebdcb1-6ed3-40c3-b913-9d10f141372c', 'bd28fa69-ad65-4665-b805-329caeb84650'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-50c523e1-7fb3-4122-ab5a-746d1b7d58cd tempest-VolumeTypesAccessTest-1813446070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-50c523e1-7fb3-4122-ab5a-746d1b7d58cd tempest-VolumeTypesAccessTest-1813446070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-50c523e1-7fb3-4122-ab5a-746d1b7d58cd tempest-VolumeTypesAccessTest-1813446070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-50c523e1-7fb3-4122-ab5a-746d1b7d58cd tempest-VolumeTypesAccessTest-1813446070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-50c523e1-7fb3-4122-ab5a-746d1b7d58cd tempest-VolumeTypesAccessTest-1813446070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-50c523e1-7fb3-4122-ab5a-746d1b7d58cd tempest-VolumeTypesAccessTest-1813446070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f8532492-05ca-47a2-b4b0-5a5223bc6cbe tempest-VolumesListAdminTestJSON-1661602241 None] Acquiring lock "cinder-6f17c50a-4197-4f84-999f-6e91abb4a234-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c5047ae9-ea24-409e-8077-1965605a552d 1073741824" returned: 0 in 0.615s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:08 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:09:08 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:08 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f8532492-05ca-47a2-b4b0-5a5223bc6cbe tempest-VolumesListAdminTestJSON-1661602241 None] Lock "cinder-6f17c50a-4197-4f84-999f-6e91abb4a234-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c5047ae9-ea24-409e-8077-1965605a552d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:08 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3c90deef-6095-4164-8439-7cc8fa6af8b3 tempest-VolumesListAdminTestJSON-1661602241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.433s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:08 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-3c90deef-6095-4164-8439-7cc8fa6af8b3 tempest-VolumesListAdminTestJSON-1661602241 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:09:08 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c5047ae9-ea24-409e-8077-1965605a552d Sep 05 05:09:09 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:09 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-3c90deef-6095-4164-8439-7cc8fa6af8b3 tempest-VolumesListAdminTestJSON-1661602241 None] Deleted volume successfully. Sep 05 05:09:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f8532492-05ca-47a2-b4b0-5a5223bc6cbe tempest-VolumesListAdminTestJSON-1661602241 None] Acquiring lock "cinder-quobyte-6f17c50a-4197-4f84-999f-6e91abb4a234" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f8532492-05ca-47a2-b4b0-5a5223bc6cbe tempest-VolumesListAdminTestJSON-1661602241 None] Lock "cinder-quobyte-6f17c50a-4197-4f84-999f-6e91abb4a234" acquired by "delete_volume" :: waited 0.035s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3c90deef-6095-4164-8439-7cc8fa6af8b3 tempest-VolumesListAdminTestJSON-1661602241 None] Lock "cinder-11c0f4db-f2d0-4b67-9c73-f6742b3de7d4-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:09 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea2d01b-d2fd-45c8-b927-6657d71a75d5]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f8532492-05ca-47a2-b4b0-5a5223bc6cbe tempest-VolumesListAdminTestJSON-1661602241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6f17c50a-4197-4f84-999f-6e91abb4a234 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:09 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6f17c50a-4197-4f84-999f-6e91abb4a234 Sep 05 05:09:09 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:09 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c5047ae9-ea24-409e-8077-1965605a552d" returned: 0 in 0.359s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:09:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be0961d-1d74-46c2-94b5-1ca3c6654180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5047ae9-ea24-409e-8077-1965605a552d', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (061e3a26-3068-41a2-93d0-5e1fbf3f2851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:09 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Volume volume-c5047ae9-ea24-409e-8077-1965605a552d (c5047ae9-ea24-409e-8077-1965605a552d): created successfully Sep 05 05:09:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (061e3a26-3068-41a2-93d0-5e1fbf3f2851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:09 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Flow 'volume_create_manager' (dff4b447-8df9-4eca-a0bb-1822cec04f61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-50c523e1-7fb3-4122-ab5a-746d1b7d58cd tempest-VolumeTypesAccessTest-1813446070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.591s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:09 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-50c523e1-7fb3-4122-ab5a-746d1b7d58cd tempest-VolumeTypesAccessTest-1813446070 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:09:09 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-50c523e1-7fb3-4122-ab5a-746d1b7d58cd tempest-VolumeTypesAccessTest-1813446070 None] Deleted volume successfully. Sep 05 05:09:09 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-a663fca4-e187-4ec7-8985-17bb003dcaea tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Created volume successfully. Sep 05 05:09:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-50c523e1-7fb3-4122-ab5a-746d1b7d58cd tempest-VolumeTypesAccessTest-1813446070 None] Lock "cinder-55ddf57d-3347-4cb2-9c19-5245da538cd1-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:09 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f8532492-05ca-47a2-b4b0-5a5223bc6cbe tempest-VolumesListAdminTestJSON-1661602241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6f17c50a-4197-4f84-999f-6e91abb4a234" returned: 0 in 0.490s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f8532492-05ca-47a2-b4b0-5a5223bc6cbe tempest-VolumesListAdminTestJSON-1661602241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6f17c50a-4197-4f84-999f-6e91abb4a234 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:09 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6f17c50a-4197-4f84-999f-6e91abb4a234 Sep 05 05:09:09 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:09 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f8532492-05ca-47a2-b4b0-5a5223bc6cbe tempest-VolumesListAdminTestJSON-1661602241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6f17c50a-4197-4f84-999f-6e91abb4a234" returned: 0 in 0.266s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f8532492-05ca-47a2-b4b0-5a5223bc6cbe tempest-VolumesListAdminTestJSON-1661602241 None] Lock "cinder-quobyte-6f17c50a-4197-4f84-999f-6e91abb4a234" released by "delete_volume" :: held 0.852s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:09 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-f8532492-05ca-47a2-b4b0-5a5223bc6cbe tempest-VolumesListAdminTestJSON-1661602241 None] Created reservations ['51c903d3-cbc8-46fd-bba6-b5bbf6954b2e', '152c7012-b65e-4519-8596-aa76219269d9', '4f259e13-dfc6-446e-8797-f1a6b31d1fb3', 'd976eb19-66d6-4aa6-9fc7-ba0af5a39f4e'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:09:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f8532492-05ca-47a2-b4b0-5a5223bc6cbe tempest-VolumesListAdminTestJSON-1661602241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f8532492-05ca-47a2-b4b0-5a5223bc6cbe tempest-VolumesListAdminTestJSON-1661602241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f8532492-05ca-47a2-b4b0-5a5223bc6cbe tempest-VolumesListAdminTestJSON-1661602241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f8532492-05ca-47a2-b4b0-5a5223bc6cbe tempest-VolumesListAdminTestJSON-1661602241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f8532492-05ca-47a2-b4b0-5a5223bc6cbe tempest-VolumesListAdminTestJSON-1661602241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f8532492-05ca-47a2-b4b0-5a5223bc6cbe tempest-VolumesListAdminTestJSON-1661602241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:10 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:09:10 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:10 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f8532492-05ca-47a2-b4b0-5a5223bc6cbe tempest-VolumesListAdminTestJSON-1661602241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.469s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:10 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-f8532492-05ca-47a2-b4b0-5a5223bc6cbe tempest-VolumesListAdminTestJSON-1661602241 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:09:10 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-f8532492-05ca-47a2-b4b0-5a5223bc6cbe tempest-VolumesListAdminTestJSON-1661602241 None] Deleted volume successfully. Sep 05 05:09:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f8532492-05ca-47a2-b4b0-5a5223bc6cbe tempest-VolumesListAdminTestJSON-1661602241 None] Lock "cinder-6f17c50a-4197-4f84-999f-6e91abb4a234-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8b1e41a3-e8bc-41ef-ba40-f83fedb39a89 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8b1e41a3-e8bc-41ef-ba40-f83fedb39a89 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8b1e41a3-e8bc-41ef-ba40-f83fedb39a89 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8b1e41a3-e8bc-41ef-ba40-f83fedb39a89 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8b1e41a3-e8bc-41ef-ba40-f83fedb39a89 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8b1e41a3-e8bc-41ef-ba40-f83fedb39a89 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:10 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:09:10 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:11 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8b1e41a3-e8bc-41ef-ba40-f83fedb39a89 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.400s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:11 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-8b1e41a3-e8bc-41ef-ba40-f83fedb39a89 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:09:11 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-8b1e41a3-e8bc-41ef-ba40-f83fedb39a89 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Retype volume completed successfully. Sep 05 05:09:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-aa951d90-d859-492c-90c9-d28125cca239 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Acquiring lock "cinder-c5047ae9-ea24-409e-8077-1965605a552d-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-aa951d90-d859-492c-90c9-d28125cca239 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Lock "cinder-c5047ae9-ea24-409e-8077-1965605a552d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-aa951d90-d859-492c-90c9-d28125cca239 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Acquiring lock "cinder-quobyte-c5047ae9-ea24-409e-8077-1965605a552d" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-aa951d90-d859-492c-90c9-d28125cca239 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Lock "cinder-quobyte-c5047ae9-ea24-409e-8077-1965605a552d" acquired by "delete_volume" :: waited 0.017s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:12 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2019be08-1ec6-47eb-ae8e-ebdfbb600de4]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa951d90-d859-492c-90c9-d28125cca239 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c5047ae9-ea24-409e-8077-1965605a552d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:12 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c5047ae9-ea24-409e-8077-1965605a552d Sep 05 05:09:12 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:12 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa951d90-d859-492c-90c9-d28125cca239 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c5047ae9-ea24-409e-8077-1965605a552d" returned: 0 in 0.477s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa951d90-d859-492c-90c9-d28125cca239 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c5047ae9-ea24-409e-8077-1965605a552d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:12 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c5047ae9-ea24-409e-8077-1965605a552d Sep 05 05:09:12 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:13 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa951d90-d859-492c-90c9-d28125cca239 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c5047ae9-ea24-409e-8077-1965605a552d" returned: 0 in 0.331s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:13 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-aa951d90-d859-492c-90c9-d28125cca239 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Lock "cinder-quobyte-c5047ae9-ea24-409e-8077-1965605a552d" released by "delete_volume" :: held 0.867s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:13 devstack cinder-volume[89331]: WARNING cinder.quota [None req-aa951d90-d859-492c-90c9-d28125cca239 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:09:13 devstack cinder-volume[89331]: WARNING cinder.quota [None req-aa951d90-d859-492c-90c9-d28125cca239 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:09:13 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-aa951d90-d859-492c-90c9-d28125cca239 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Created reservations ['fa68eebb-248e-4cce-835d-7402557eb3cb', 'f8daffd8-93c3-443c-8993-beb78d4de9c6', 'e60309a8-c4e0-4161-93e1-89dfc69f4f3e', '10bb61c3-200f-4111-9e2b-73149e17eff6'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:09:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-aa951d90-d859-492c-90c9-d28125cca239 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-aa951d90-d859-492c-90c9-d28125cca239 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:13 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-aa951d90-d859-492c-90c9-d28125cca239 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:13 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-aa951d90-d859-492c-90c9-d28125cca239 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-aa951d90-d859-492c-90c9-d28125cca239 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa951d90-d859-492c-90c9-d28125cca239 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:13 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:09:13 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:13 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa951d90-d859-492c-90c9-d28125cca239 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.335s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:13 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-aa951d90-d859-492c-90c9-d28125cca239 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:09:13 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-aa951d90-d859-492c-90c9-d28125cca239 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Deleted volume successfully. Sep 05 05:09:13 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-aa951d90-d859-492c-90c9-d28125cca239 tempest-VolumeRetypeWithoutMigrationTest-511765150 None] Lock "cinder-c5047ae9-ea24-409e-8077-1965605a552d-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Flow 'volume_create_manager' (3e6bc48e-5f52-4a88-9bdf-8b6c9733ec7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482777fc-a713-42f2-a1ac-8b7c4609748c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482777fc-a713-42f2-a1ac-8b7c4609748c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-470448993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b70a14d0-6364-42e6-885a-8b14cafa7173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eedc8dde3554985b6fed699b9a4bf30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:19Z,use_quota=True,user_id='fa58120dd57c405cac53f0a56c3349ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3691fa2-eee6-4bc8-9aa1-aa9e8db93d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3691fa2-eee6-4bc8-9aa1-aa9e8db93d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61957bf8-6fad-4288-95a1-beca504e2e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61957bf8-6fad-4288-95a1-beca504e2e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b70a14d0-6364-42e6-885a-8b14cafa7173', 'volume_name': 'volume-b70a14d0-6364-42e6-885a-8b14cafa7173', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf3f8fd-e466-4517-9a7b-9a0e5cad0545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf3f8fd-e466-4517-9a7b-9a0e5cad0545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d232f345-6b4e-4c82-bc1d-3df8597c963c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:19 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Volume b70a14d0-6364-42e6-885a-8b14cafa7173: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b70a14d0-6364-42e6-885a-8b14cafa7173', 'volume_size': 1} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-470448993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b70a14d0-6364-42e6-885a-8b14cafa7173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eedc8dde3554985b6fed699b9a4bf30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:19Z,use_quota=True,user_id='fa58120dd57c405cac53f0a56c3349ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Creating volume b70a14d0-6364-42e6-885a-8b14cafa7173 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:09:19 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b70a14d0-6364-42e6-885a-8b14cafa7173 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:19 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b70a14d0-6364-42e6-885a-8b14cafa7173 1073741824 Sep 05 05:09:19 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Flow 'volume_create_manager' (c2def5c0-4c07-4d08-9f14-01e63c4ab961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf141cb-4e99-4b01-93d0-ff1f2ef405fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:19 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b70a14d0-6364-42e6-885a-8b14cafa7173 1073741824" returned: 0 in 0.647s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf141cb-4e99-4b01-93d0-ff1f2ef405fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-822886916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f37ed56-5ed3-474a-a6f5-e18aadb93e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd64ca03f8a43368ebe76a7bb216b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:20Z,use_quota=True,user_id='edfd00fd18824f70b7251d2b58529290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6df64a1-832b-41b0-a967-7a482e1ea42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6df64a1-832b-41b0-a967-7a482e1ea42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc36f08-a859-4286-a12d-7a22577cad64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG cinder.image.glance [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Creating Keystone auth plugin from conf {{(pid=89331) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 05:09:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b70a14d0-6364-42e6-885a-8b14cafa7173 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:19 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b70a14d0-6364-42e6-885a-8b14cafa7173 Sep 05 05:09:19 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:20 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b70a14d0-6364-42e6-885a-8b14cafa7173" returned: 0 in 0.285s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:09:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d232f345-6b4e-4c82-bc1d-3df8597c963c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b70a14d0-6364-42e6-885a-8b14cafa7173', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9acd2d3-5276-4084-bdc8-f8447455bb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:20 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Volume volume-b70a14d0-6364-42e6-885a-8b14cafa7173 (b70a14d0-6364-42e6-885a-8b14cafa7173): created successfully Sep 05 05:09:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9acd2d3-5276-4084-bdc8-f8447455bb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Flow 'volume_create_manager' (3e6bc48e-5f52-4a88-9bdf-8b6c9733ec7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:20 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-68ef921b-6044-4317-a2b5-390b81fdab99 tempest-VolumesMetadataTest-1613559527 None] Created volume successfully. Sep 05 05:09:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc36f08-a859-4286-a12d-7a22577cad64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5f37ed56-5ed3-474a-a6f5-e18aadb93e5c', 'volume_name': 'volume-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c', 'volume_size': 1, 'image_id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '06b067117d184688bd2e16e21ff323f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'created_at': datetime.datetime(2026, 9, 5, 2, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 55, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69912c5a-0a4c-412c-9388-774757f595ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69912c5a-0a4c-412c-9388-774757f595ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc87a18-ba64-41bd-8d37-564504ff18e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:20 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Volume 5f37ed56-5ed3-474a-a6f5-e18aadb93e5c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c', 'volume_size': 1, 'image_id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '06b067117d184688bd2e16e21ff323f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'created_at': datetime.datetime(2026, 9, 5, 2, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 55, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 05:09:20 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Trying to clone 5f37ed56-5ed3-474a-a6f5-e18aadb93e5c from image a60f4e58-9471-4dd7-bff3-114bdbd77a8d at location (None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}]). {{(pid=89331) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 05:09:21 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_kac8z8vedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 05:09:21 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Image download 20.69 MB at 20.69 MB/s Sep 05 05:09:21 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7800bd26-3f8b-4a35-81de-d756d9a5a717]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_kac8z8vedevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:21 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_kac8z8vedevstack@QuobyteHD Sep 05 05:09:21 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:21 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_kac8z8vedevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:21 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Temporary image a60f4e58-9471-4dd7-bff3-114bdbd77a8d is fetched for user edfd00fd18824f70b7251d2b58529290. {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 05:09:21 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8772cd-2212-4fec-a1bf-6c2cc172a650]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_kac8z8vedevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:21 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_kac8z8vedevstack@QuobyteHD Sep 05 05:09:21 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:22 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_kac8z8vedevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-822886916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f37ed56-5ed3-474a-a6f5-e18aadb93e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd64ca03f8a43368ebe76a7bb216b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:20Z,use_quota=True,user_id='edfd00fd18824f70b7251d2b58529290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:09:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Creating volume 5f37ed56-5ed3-474a-a6f5-e18aadb93e5c {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:09:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:09:22 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:09:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:22 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c 1073741824 Sep 05 05:09:22 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:22 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-72624a45-f840-43be-8225-b6b981591d6d tempest-VolumesMetadataTest-1613559527 None] Acquiring lock "cinder-b70a14d0-6364-42e6-885a-8b14cafa7173-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:22 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-72624a45-f840-43be-8225-b6b981591d6d tempest-VolumesMetadataTest-1613559527 None] Lock "cinder-b70a14d0-6364-42e6-885a-8b14cafa7173-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:22 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-72624a45-f840-43be-8225-b6b981591d6d tempest-VolumesMetadataTest-1613559527 None] Acquiring lock "cinder-quobyte-b70a14d0-6364-42e6-885a-8b14cafa7173" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:22 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-72624a45-f840-43be-8225-b6b981591d6d tempest-VolumesMetadataTest-1613559527 None] Lock "cinder-quobyte-b70a14d0-6364-42e6-885a-8b14cafa7173" acquired by "delete_volume" :: waited 0.025s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:22 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05fa803-d2c8-4eae-b704-0a829c0ca75d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-72624a45-f840-43be-8225-b6b981591d6d tempest-VolumesMetadataTest-1613559527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b70a14d0-6364-42e6-885a-8b14cafa7173 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:22 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b70a14d0-6364-42e6-885a-8b14cafa7173 Sep 05 05:09:22 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:22 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c 1073741824" returned: 0 in 0.606s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:22 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c Sep 05 05:09:22 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:23 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-72624a45-f840-43be-8225-b6b981591d6d tempest-VolumesMetadataTest-1613559527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b70a14d0-6364-42e6-885a-8b14cafa7173" returned: 0 in 0.604s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-72624a45-f840-43be-8225-b6b981591d6d tempest-VolumesMetadataTest-1613559527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b70a14d0-6364-42e6-885a-8b14cafa7173 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:23 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b70a14d0-6364-42e6-885a-8b14cafa7173 Sep 05 05:09:23 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:23 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c" returned: 0 in 0.493s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Attempting download of a60f4e58-9471-4dd7-bff3-114bdbd77a8d ((None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}])) to volume 5f37ed56-5ed3-474a-a6f5-e18aadb93e5c. {{(pid=89331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Flow 'volume_create_manager' (614d9da4-dc3a-4206-b14e-1625ee510792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9770be-25c9-4a56-a7a5-1cf10102208a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9770be-25c9-4a56-a7a5-1cf10102208a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1505167994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e637ef-1b77-48d1-96df-98c66b7f9093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='905cf2f2462b45f9a8b221381a85ae53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:23Z,use_quota=True,user_id='dc4adc4e27b0440aae5e5d5e77607317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (046fa464-f4d4-4965-8024-598b66970cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (046fa464-f4d4-4965-8024-598b66970cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3faf2bf2-af95-431f-8272-668885c268a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3faf2bf2-af95-431f-8272-668885c268a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6e637ef-1b77-48d1-96df-98c66b7f9093', 'volume_name': 'volume-d6e637ef-1b77-48d1-96df-98c66b7f9093', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d60573-0f4c-43e2-a06e-ba1115aa2106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d60573-0f4c-43e2-a06e-ba1115aa2106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41254768-ca7c-4d45-a16a-6dcdc23a6fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:23 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Volume d6e637ef-1b77-48d1-96df-98c66b7f9093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6e637ef-1b77-48d1-96df-98c66b7f9093', 'volume_size': 1} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1505167994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e637ef-1b77-48d1-96df-98c66b7f9093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='905cf2f2462b45f9a8b221381a85ae53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:23Z,use_quota=True,user_id='dc4adc4e27b0440aae5e5d5e77607317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Creating volume d6e637ef-1b77-48d1-96df-98c66b7f9093 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:23 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:09:23 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d6e637ef-1b77-48d1-96df-98c66b7f9093 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-72624a45-f840-43be-8225-b6b981591d6d tempest-VolumesMetadataTest-1613559527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b70a14d0-6364-42e6-885a-8b14cafa7173" returned: 0 in 0.415s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46a80f8-f3ad-4a7e-ae8b-a3d7a7ca375f]: (4, 'raw') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_lx3jq3ub {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:23 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d6e637ef-1b77-48d1-96df-98c66b7f9093 1073741824 Sep 05 05:09:23 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-72624a45-f840-43be-8225-b6b981591d6d tempest-VolumesMetadataTest-1613559527 None] Lock "cinder-quobyte-b70a14d0-6364-42e6-885a-8b14cafa7173" released by "delete_volume" :: held 1.079s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-72624a45-f840-43be-8225-b6b981591d6d tempest-VolumesMetadataTest-1613559527 None] Created reservations ['c878d354-188d-4997-838d-fd0076c64cc4', '221c95dc-ce20-45ea-b09c-aeaffaad6fc5', 'd9753033-c3a5-4bff-83ea-c3159683e7be', 'daec2e5f-ea51-4095-a04b-e7aab4ee22c0'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:09:23 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_lx3jq3ub Sep 05 05:09:23 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-72624a45-f840-43be-8225-b6b981591d6d tempest-VolumesMetadataTest-1613559527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-72624a45-f840-43be-8225-b6b981591d6d tempest-VolumesMetadataTest-1613559527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-72624a45-f840-43be-8225-b6b981591d6d tempest-VolumesMetadataTest-1613559527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-72624a45-f840-43be-8225-b6b981591d6d tempest-VolumesMetadataTest-1613559527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-72624a45-f840-43be-8225-b6b981591d6d tempest-VolumesMetadataTest-1613559527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-72624a45-f840-43be-8225-b6b981591d6d tempest-VolumesMetadataTest-1613559527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:23 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:09:23 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:24 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_lx3jq3ub" returned: 0 in 0.410s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_lx3jq3ub {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:24 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-72624a45-f840-43be-8225-b6b981591d6d tempest-VolumesMetadataTest-1613559527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.349s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:24 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-72624a45-f840-43be-8225-b6b981591d6d tempest-VolumesMetadataTest-1613559527 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:09:24 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-72624a45-f840-43be-8225-b6b981591d6d tempest-VolumesMetadataTest-1613559527 None] Deleted volume successfully. Sep 05 05:09:24 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_lx3jq3ub Sep 05 05:09:24 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:24 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d6e637ef-1b77-48d1-96df-98c66b7f9093 1073741824" returned: 0 in 0.601s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:24 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-72624a45-f840-43be-8225-b6b981591d6d tempest-VolumesMetadataTest-1613559527 None] Lock "cinder-b70a14d0-6364-42e6-885a-8b14cafa7173-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d6e637ef-1b77-48d1-96df-98c66b7f9093 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:24 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d6e637ef-1b77-48d1-96df-98c66b7f9093 Sep 05 05:09:24 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:24 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_lx3jq3ub" returned: 1 in 0.392s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_lx3jq3ub' failed. Not Retrying. {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 05:09:24 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f824353c-abfb-438c-bad9-5eb88b8c21fb]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_kac8z8vedevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:24 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d6e637ef-1b77-48d1-96df-98c66b7f9093" returned: 0 in 0.292s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:24 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:09:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:24 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_kac8z8vedevstack@QuobyteHD Sep 05 05:09:24 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41254768-ca7c-4d45-a16a-6dcdc23a6fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6e637ef-1b77-48d1-96df-98c66b7f9093', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9f7c52-fbb9-4a36-a8b3-6d7c0ebbc128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:24 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Volume volume-d6e637ef-1b77-48d1-96df-98c66b7f9093 (d6e637ef-1b77-48d1-96df-98c66b7f9093): created successfully Sep 05 05:09:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9f7c52-fbb9-4a36-a8b3-6d7c0ebbc128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Flow 'volume_create_manager' (614d9da4-dc3a-4206-b14e-1625ee510792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:24 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-5b8fd775-f880-4be6-b1dd-76f7f0a5b3d0 tempest-VolumesServicesTestJSON-521904775 None] Created volume successfully. Sep 05 05:09:24 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_kac8z8vedevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:24 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] a60f4e58-9471-4dd7-bff3-114bdbd77a8d was qcow2, converting to qcow2 {{(pid=89331) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 05:09:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_kac8z8vedevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:24 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_kac8z8vedevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c Sep 05 05:09:24 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:25 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7e9b31e0-4315-4571-aeeb-31927191e0b8 tempest-VolumesServicesTestJSON-521904775 None] Acquiring lock "cinder-d6e637ef-1b77-48d1-96df-98c66b7f9093-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:25 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7e9b31e0-4315-4571-aeeb-31927191e0b8 tempest-VolumesServicesTestJSON-521904775 None] Lock "cinder-d6e637ef-1b77-48d1-96df-98c66b7f9093-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:25 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7e9b31e0-4315-4571-aeeb-31927191e0b8 tempest-VolumesServicesTestJSON-521904775 None] Acquiring lock "cinder-quobyte-d6e637ef-1b77-48d1-96df-98c66b7f9093" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:25 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7e9b31e0-4315-4571-aeeb-31927191e0b8 tempest-VolumesServicesTestJSON-521904775 None] Lock "cinder-quobyte-d6e637ef-1b77-48d1-96df-98c66b7f9093" acquired by "delete_volume" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:25 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[72451aee-5aab-4abc-a3ff-15d6d148227f]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7e9b31e0-4315-4571-aeeb-31927191e0b8 tempest-VolumesServicesTestJSON-521904775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d6e637ef-1b77-48d1-96df-98c66b7f9093 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:26 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d6e637ef-1b77-48d1-96df-98c66b7f9093 Sep 05 05:09:26 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:26 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7e9b31e0-4315-4571-aeeb-31927191e0b8 tempest-VolumesServicesTestJSON-521904775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d6e637ef-1b77-48d1-96df-98c66b7f9093" returned: 0 in 0.535s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7e9b31e0-4315-4571-aeeb-31927191e0b8 tempest-VolumesServicesTestJSON-521904775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d6e637ef-1b77-48d1-96df-98c66b7f9093 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:26 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d6e637ef-1b77-48d1-96df-98c66b7f9093 Sep 05 05:09:26 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:26 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7e9b31e0-4315-4571-aeeb-31927191e0b8 tempest-VolumesServicesTestJSON-521904775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d6e637ef-1b77-48d1-96df-98c66b7f9093" returned: 0 in 0.307s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:26 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7e9b31e0-4315-4571-aeeb-31927191e0b8 tempest-VolumesServicesTestJSON-521904775 None] Lock "cinder-quobyte-d6e637ef-1b77-48d1-96df-98c66b7f9093" released by "delete_volume" :: held 0.902s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:26 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-7e9b31e0-4315-4571-aeeb-31927191e0b8 tempest-VolumesServicesTestJSON-521904775 None] Created reservations ['5ac5d4f1-bb2b-461e-abab-1540752aa925', '1ef3cafa-8155-4f38-b6e2-0bd178b61993', '66093387-d01e-46cb-8ff3-e22e7e1cdc3f', '12fde139-98cf-4633-881f-9674165704c9'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:09:26 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_kac8z8vedevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c" returned: 0 in 2.151s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:26 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_kac8z8vedevstack@QuobyteHD, size 112.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:09:26 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Converted 112.00 MB image at 51.95 MB/s Sep 05 05:09:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7e9b31e0-4315-4571-aeeb-31927191e0b8 tempest-VolumesServicesTestJSON-521904775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7e9b31e0-4315-4571-aeeb-31927191e0b8 tempest-VolumesServicesTestJSON-521904775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7e9b31e0-4315-4571-aeeb-31927191e0b8 tempest-VolumesServicesTestJSON-521904775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:26 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c 1G Sep 05 05:09:26 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7e9b31e0-4315-4571-aeeb-31927191e0b8 tempest-VolumesServicesTestJSON-521904775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7e9b31e0-4315-4571-aeeb-31927191e0b8 tempest-VolumesServicesTestJSON-521904775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7e9b31e0-4315-4571-aeeb-31927191e0b8 tempest-VolumesServicesTestJSON-521904775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:27 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:09:27 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:27 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7e9b31e0-4315-4571-aeeb-31927191e0b8 tempest-VolumesServicesTestJSON-521904775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.336s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:27 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-7e9b31e0-4315-4571-aeeb-31927191e0b8 tempest-VolumesServicesTestJSON-521904775 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:09:27 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-7e9b31e0-4315-4571-aeeb-31927191e0b8 tempest-VolumesServicesTestJSON-521904775 None] Deleted volume successfully. Sep 05 05:09:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7e9b31e0-4315-4571-aeeb-31927191e0b8 tempest-VolumesServicesTestJSON-521904775 None] Lock "cinder-d6e637ef-1b77-48d1-96df-98c66b7f9093-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:27 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c 1G" returned: 0 in 0.470s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:27 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Downloaded image a60f4e58-9471-4dd7-bff3-114bdbd77a8d ((None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}])) to volume 5f37ed56-5ed3-474a-a6f5-e18aadb93e5c successfully. {{(pid=89331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 05:09:27 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Temporary image a60f4e58-9471-4dd7-bff3-114bdbd77a8d for user edfd00fd18824f70b7251d2b58529290 is deleted. {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 05:09:27 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Marking volume 5f37ed56-5ed3-474a-a6f5-e18aadb93e5c as bootable. {{(pid=89331) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 05:09:27 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Copying metadata from image a60f4e58-9471-4dd7-bff3-114bdbd77a8d to 5f37ed56-5ed3-474a-a6f5-e18aadb93e5c. {{(pid=89331) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 05:09:27 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Creating volume glance metadata for volume 5f37ed56-5ed3-474a-a6f5-e18aadb93e5c backed by image a60f4e58-9471-4dd7-bff3-114bdbd77a8d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89331) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 05:09:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc87a18-ba64-41bd-8d37-564504ff18e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c', 'volume_size': 1, 'image_id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '06b067117d184688bd2e16e21ff323f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'created_at': datetime.datetime(2026, 9, 5, 2, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 55, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11659b6b-c352-4858-832d-da503012046d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:27 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Volume volume-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c (5f37ed56-5ed3-474a-a6f5-e18aadb93e5c): created successfully Sep 05 05:09:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11659b6b-c352-4858-832d-da503012046d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Flow 'volume_create_manager' (c2def5c0-4c07-4d08-9f14-01e63c4ab961) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:27 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-2695d8df-dc81-45cf-aaa0-d67a902870d1 tempest-VolumesImageMetadata-995907111 None] Created volume successfully. Sep 05 05:09:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-93f82645-f836-4df0-97ef-635b20fcf5c4 tempest-VolumesImageMetadata-995907111 None] Acquiring lock "cinder-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-93f82645-f836-4df0-97ef-635b20fcf5c4 tempest-VolumesImageMetadata-995907111 None] Lock "cinder-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-93f82645-f836-4df0-97ef-635b20fcf5c4 tempest-VolumesImageMetadata-995907111 None] Acquiring lock "cinder-quobyte-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-93f82645-f836-4df0-97ef-635b20fcf5c4 tempest-VolumesImageMetadata-995907111 None] Lock "cinder-quobyte-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c" acquired by "delete_volume" :: waited 0.017s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:29 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[332c9270-94b4-424f-a525-2f3645f097fa]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-93f82645-f836-4df0-97ef-635b20fcf5c4 tempest-VolumesImageMetadata-995907111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:29 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c Sep 05 05:09:29 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:29 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-93f82645-f836-4df0-97ef-635b20fcf5c4 tempest-VolumesImageMetadata-995907111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c" returned: 0 in 0.379s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-93f82645-f836-4df0-97ef-635b20fcf5c4 tempest-VolumesImageMetadata-995907111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:29 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c Sep 05 05:09:29 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:29 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-93f82645-f836-4df0-97ef-635b20fcf5c4 tempest-VolumesImageMetadata-995907111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c" returned: 0 in 0.348s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-93f82645-f836-4df0-97ef-635b20fcf5c4 tempest-VolumesImageMetadata-995907111 None] Lock "cinder-quobyte-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c" released by "delete_volume" :: held 0.795s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:30 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-93f82645-f836-4df0-97ef-635b20fcf5c4 tempest-VolumesImageMetadata-995907111 None] Created reservations ['59e5db85-4f05-42a8-a433-d21f5967d399', 'e134c9f2-98fb-4e90-a3ab-5eaf27f2ee78', '8dd1a044-a8c0-4318-a82e-754f50512450', 'c69a679a-3dc6-464a-90be-822d008947c2'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:09:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-93f82645-f836-4df0-97ef-635b20fcf5c4 tempest-VolumesImageMetadata-995907111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-93f82645-f836-4df0-97ef-635b20fcf5c4 tempest-VolumesImageMetadata-995907111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:30 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-93f82645-f836-4df0-97ef-635b20fcf5c4 tempest-VolumesImageMetadata-995907111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:30 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-93f82645-f836-4df0-97ef-635b20fcf5c4 tempest-VolumesImageMetadata-995907111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-93f82645-f836-4df0-97ef-635b20fcf5c4 tempest-VolumesImageMetadata-995907111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-93f82645-f836-4df0-97ef-635b20fcf5c4 tempest-VolumesImageMetadata-995907111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:30 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:09:30 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:30 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-93f82645-f836-4df0-97ef-635b20fcf5c4 tempest-VolumesImageMetadata-995907111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.506s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:30 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-93f82645-f836-4df0-97ef-635b20fcf5c4 tempest-VolumesImageMetadata-995907111 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:09:30 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-93f82645-f836-4df0-97ef-635b20fcf5c4 tempest-VolumesImageMetadata-995907111 None] Deleted volume successfully. Sep 05 05:09:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-93f82645-f836-4df0-97ef-635b20fcf5c4 tempest-VolumesImageMetadata-995907111 None] Lock "cinder-5f37ed56-5ed3-474a-a6f5-e18aadb93e5c-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Flow 'volume_create_manager' (5a50068f-15a5-4f02-bcc2-fbdb3fe5044a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee4f119-5a85-4439-b6df-674e0f7dda53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee4f119-5a85-4439-b6df-674e0f7dda53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-368166610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf97c52-69a4-4b8f-af9c-ab97e15164a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d737a98c74554f5db3cc0e4e5c47dab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:33Z,use_quota=True,user_id='5ba6f910d7884a3f9318852f500fe0b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a3a359-9ee4-4305-9ec9-4f7f5b0c73eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a3a359-9ee4-4305-9ec9-4f7f5b0c73eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c4c5b30-c38a-4011-a58a-6cfcac31334f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c4c5b30-c38a-4011-a58a-6cfcac31334f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bf97c52-69a4-4b8f-af9c-ab97e15164a3', 'volume_name': 'volume-2bf97c52-69a4-4b8f-af9c-ab97e15164a3', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77724e92-e12f-43fb-adc7-3ef655203403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77724e92-e12f-43fb-adc7-3ef655203403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b007a48-b04c-4007-8a7c-c0b2f6de13e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:33 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Volume 2bf97c52-69a4-4b8f-af9c-ab97e15164a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bf97c52-69a4-4b8f-af9c-ab97e15164a3', 'volume_size': 1} Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-368166610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf97c52-69a4-4b8f-af9c-ab97e15164a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d737a98c74554f5db3cc0e4e5c47dab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:33Z,use_quota=True,user_id='5ba6f910d7884a3f9318852f500fe0b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Creating volume 2bf97c52-69a4-4b8f-af9c-ab97e15164a3 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:09:33 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bf97c52-69a4-4b8f-af9c-ab97e15164a3 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:33 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bf97c52-69a4-4b8f-af9c-ab97e15164a3 1073741824 Sep 05 05:09:33 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:33 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bf97c52-69a4-4b8f-af9c-ab97e15164a3 1073741824" returned: 0 in 0.484s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bf97c52-69a4-4b8f-af9c-ab97e15164a3 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:33 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bf97c52-69a4-4b8f-af9c-ab97e15164a3 Sep 05 05:09:33 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:34 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bf97c52-69a4-4b8f-af9c-ab97e15164a3" returned: 0 in 0.261s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:09:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b007a48-b04c-4007-8a7c-c0b2f6de13e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bf97c52-69a4-4b8f-af9c-ab97e15164a3', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c6aa12-b1cf-4c9e-b1df-510292cd2c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:34 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Volume volume-2bf97c52-69a4-4b8f-af9c-ab97e15164a3 (2bf97c52-69a4-4b8f-af9c-ab97e15164a3): created successfully Sep 05 05:09:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c6aa12-b1cf-4c9e-b1df-510292cd2c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Flow 'volume_create_manager' (5a50068f-15a5-4f02-bcc2-fbdb3fe5044a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:34 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-dda67f6e-be10-4eb9-9f12-b2e9e4fa4b54 tempest-VolumesTransfersV357Test-142945188 None] Created volume successfully. Sep 05 05:09:36 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=142,cinder:INSERT=50,cinder:UPDATE=197,cinder:DELETE=14 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:09:36 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-2f2951c3-d539-49f9-80e4-91a9adfc9811 tempest-VolumesTransfersV357Test-1617802160 None] Transfer volume completed successfully. Sep 05 05:09:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-180030b3-5383-4c49-a8dd-2c6e6cc97cb2 tempest-VolumesTransfersV357Test-1737582895 None] Acquiring lock "cinder-2bf97c52-69a4-4b8f-af9c-ab97e15164a3-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-180030b3-5383-4c49-a8dd-2c6e6cc97cb2 tempest-VolumesTransfersV357Test-1737582895 None] Lock "cinder-2bf97c52-69a4-4b8f-af9c-ab97e15164a3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:37 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=164,cinder:INSERT=49,cinder:UPDATE=197,cinder:DELETE=14 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:09:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-180030b3-5383-4c49-a8dd-2c6e6cc97cb2 tempest-VolumesTransfersV357Test-1737582895 None] Acquiring lock "cinder-quobyte-2bf97c52-69a4-4b8f-af9c-ab97e15164a3" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-180030b3-5383-4c49-a8dd-2c6e6cc97cb2 tempest-VolumesTransfersV357Test-1737582895 None] Lock "cinder-quobyte-2bf97c52-69a4-4b8f-af9c-ab97e15164a3" acquired by "delete_volume" :: waited 0.017s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:37 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e61212-42b7-47ee-b776-63158c0b7e8b]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-180030b3-5383-4c49-a8dd-2c6e6cc97cb2 tempest-VolumesTransfersV357Test-1737582895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bf97c52-69a4-4b8f-af9c-ab97e15164a3 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:37 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bf97c52-69a4-4b8f-af9c-ab97e15164a3 Sep 05 05:09:37 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:37 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-180030b3-5383-4c49-a8dd-2c6e6cc97cb2 tempest-VolumesTransfersV357Test-1737582895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bf97c52-69a4-4b8f-af9c-ab97e15164a3" returned: 0 in 0.399s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-180030b3-5383-4c49-a8dd-2c6e6cc97cb2 tempest-VolumesTransfersV357Test-1737582895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bf97c52-69a4-4b8f-af9c-ab97e15164a3 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:37 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bf97c52-69a4-4b8f-af9c-ab97e15164a3 Sep 05 05:09:37 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:38 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-180030b3-5383-4c49-a8dd-2c6e6cc97cb2 tempest-VolumesTransfersV357Test-1737582895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-2bf97c52-69a4-4b8f-af9c-ab97e15164a3" returned: 0 in 0.292s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-180030b3-5383-4c49-a8dd-2c6e6cc97cb2 tempest-VolumesTransfersV357Test-1737582895 None] Lock "cinder-quobyte-2bf97c52-69a4-4b8f-af9c-ab97e15164a3" released by "delete_volume" :: held 0.753s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:38 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-180030b3-5383-4c49-a8dd-2c6e6cc97cb2 tempest-VolumesTransfersV357Test-1737582895 None] Created reservations ['906be5d9-40f5-4b85-b4fe-8ddf343fa2ee', 'd06515e3-6cc0-4d40-b7b5-112ffcfa8b01', 'eeb5eecb-134b-444c-8b60-1858b4e7e50c', '507acd64-09db-4e8c-996a-8c17903621ba'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:09:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-180030b3-5383-4c49-a8dd-2c6e6cc97cb2 tempest-VolumesTransfersV357Test-1737582895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-180030b3-5383-4c49-a8dd-2c6e6cc97cb2 tempest-VolumesTransfersV357Test-1737582895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:38 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-180030b3-5383-4c49-a8dd-2c6e6cc97cb2 tempest-VolumesTransfersV357Test-1737582895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:38 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-180030b3-5383-4c49-a8dd-2c6e6cc97cb2 tempest-VolumesTransfersV357Test-1737582895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-180030b3-5383-4c49-a8dd-2c6e6cc97cb2 tempest-VolumesTransfersV357Test-1737582895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-180030b3-5383-4c49-a8dd-2c6e6cc97cb2 tempest-VolumesTransfersV357Test-1737582895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:38 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:09:38 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:38 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-180030b3-5383-4c49-a8dd-2c6e6cc97cb2 tempest-VolumesTransfersV357Test-1737582895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.272s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:38 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-180030b3-5383-4c49-a8dd-2c6e6cc97cb2 tempest-VolumesTransfersV357Test-1737582895 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:09:38 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-180030b3-5383-4c49-a8dd-2c6e6cc97cb2 tempest-VolumesTransfersV357Test-1737582895 None] Deleted volume successfully. Sep 05 05:09:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-180030b3-5383-4c49-a8dd-2c6e6cc97cb2 tempest-VolumesTransfersV357Test-1737582895 None] Lock "cinder-2bf97c52-69a4-4b8f-af9c-ab97e15164a3-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:39 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:09:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Flow 'volume_create_manager' (ae018bdc-cf33-4fef-a96e-b65056f9f526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f18ce21-f261-4156-a89d-71058d1f32db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f18ce21-f261-4156-a89d-71058d1f32db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1382994305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a57e125-6eff-4d57-bf57-3fff723b7505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d737a98c74554f5db3cc0e4e5c47dab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:39Z,use_quota=True,user_id='5ba6f910d7884a3f9318852f500fe0b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0445ba-170d-4e68-b2d4-430855d52161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0445ba-170d-4e68-b2d4-430855d52161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bce0c74-ea77-49cd-a627-90663500e877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bce0c74-ea77-49cd-a627-90663500e877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a57e125-6eff-4d57-bf57-3fff723b7505', 'volume_name': 'volume-4a57e125-6eff-4d57-bf57-3fff723b7505', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1acb74f-9b6b-4671-b98c-4d3d0778ffb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1acb74f-9b6b-4671-b98c-4d3d0778ffb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (550bdeef-6305-42a0-bdaf-3b1ce09612c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:39 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Volume 4a57e125-6eff-4d57-bf57-3fff723b7505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a57e125-6eff-4d57-bf57-3fff723b7505', 'volume_size': 1} Sep 05 05:09:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1382994305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a57e125-6eff-4d57-bf57-3fff723b7505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d737a98c74554f5db3cc0e4e5c47dab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:39Z,use_quota=True,user_id='5ba6f910d7884a3f9318852f500fe0b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:09:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Creating volume 4a57e125-6eff-4d57-bf57-3fff723b7505 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:09:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:09:39 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:09:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4a57e125-6eff-4d57-bf57-3fff723b7505 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:39 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4a57e125-6eff-4d57-bf57-3fff723b7505 1073741824 Sep 05 05:09:39 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:40 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4a57e125-6eff-4d57-bf57-3fff723b7505 1073741824" returned: 0 in 0.631s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4a57e125-6eff-4d57-bf57-3fff723b7505 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:40 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4a57e125-6eff-4d57-bf57-3fff723b7505 Sep 05 05:09:40 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:40 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4a57e125-6eff-4d57-bf57-3fff723b7505" returned: 0 in 0.294s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:40 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:09:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:40 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (550bdeef-6305-42a0-bdaf-3b1ce09612c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a57e125-6eff-4d57-bf57-3fff723b7505', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:40 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3463c61-f1aa-450f-bc9a-8bc43d50d974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:40 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Volume volume-4a57e125-6eff-4d57-bf57-3fff723b7505 (4a57e125-6eff-4d57-bf57-3fff723b7505): created successfully Sep 05 05:09:40 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3463c61-f1aa-450f-bc9a-8bc43d50d974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:40 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Flow 'volume_create_manager' (ae018bdc-cf33-4fef-a96e-b65056f9f526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:40 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-a24ff40e-f1a4-408f-8ec0-c285eb971216 tempest-VolumesTransfersV357Test-142945188 None] Created volume successfully. Sep 05 05:09:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d60e7927-98e1-423f-8347-b1ee83b404ba tempest-VolumesTransfersV357Test-1737582895 None] Acquiring lock "cinder-4a57e125-6eff-4d57-bf57-3fff723b7505-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d60e7927-98e1-423f-8347-b1ee83b404ba tempest-VolumesTransfersV357Test-1737582895 None] Lock "cinder-4a57e125-6eff-4d57-bf57-3fff723b7505-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d60e7927-98e1-423f-8347-b1ee83b404ba tempest-VolumesTransfersV357Test-1737582895 None] Acquiring lock "cinder-quobyte-4a57e125-6eff-4d57-bf57-3fff723b7505" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d60e7927-98e1-423f-8347-b1ee83b404ba tempest-VolumesTransfersV357Test-1737582895 None] Lock "cinder-quobyte-4a57e125-6eff-4d57-bf57-3fff723b7505" acquired by "delete_volume" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:41 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5b6293-38cd-41a9-8b68-f661af63332d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d60e7927-98e1-423f-8347-b1ee83b404ba tempest-VolumesTransfersV357Test-1737582895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4a57e125-6eff-4d57-bf57-3fff723b7505 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:42 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4a57e125-6eff-4d57-bf57-3fff723b7505 Sep 05 05:09:42 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:42 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d60e7927-98e1-423f-8347-b1ee83b404ba tempest-VolumesTransfersV357Test-1737582895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4a57e125-6eff-4d57-bf57-3fff723b7505" returned: 0 in 0.503s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d60e7927-98e1-423f-8347-b1ee83b404ba tempest-VolumesTransfersV357Test-1737582895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4a57e125-6eff-4d57-bf57-3fff723b7505 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:42 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4a57e125-6eff-4d57-bf57-3fff723b7505 Sep 05 05:09:42 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:42 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d60e7927-98e1-423f-8347-b1ee83b404ba tempest-VolumesTransfersV357Test-1737582895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4a57e125-6eff-4d57-bf57-3fff723b7505" returned: 0 in 0.330s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:42 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d60e7927-98e1-423f-8347-b1ee83b404ba tempest-VolumesTransfersV357Test-1737582895 None] Lock "cinder-quobyte-4a57e125-6eff-4d57-bf57-3fff723b7505" released by "delete_volume" :: held 0.901s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:42 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-d60e7927-98e1-423f-8347-b1ee83b404ba tempest-VolumesTransfersV357Test-1737582895 None] Created reservations ['18259272-ee6e-4925-a0e3-43640660e9ce', 'd6e20608-38cb-4db8-bc4e-c03e91f9b3c8', '2073609e-965a-418d-9e30-ecc00bde0e44', '88ac4456-42bc-4e74-9748-f7b51f5652bc'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:09:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d60e7927-98e1-423f-8347-b1ee83b404ba tempest-VolumesTransfersV357Test-1737582895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d60e7927-98e1-423f-8347-b1ee83b404ba tempest-VolumesTransfersV357Test-1737582895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:42 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d60e7927-98e1-423f-8347-b1ee83b404ba tempest-VolumesTransfersV357Test-1737582895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:42 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d60e7927-98e1-423f-8347-b1ee83b404ba tempest-VolumesTransfersV357Test-1737582895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d60e7927-98e1-423f-8347-b1ee83b404ba tempest-VolumesTransfersV357Test-1737582895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d60e7927-98e1-423f-8347-b1ee83b404ba tempest-VolumesTransfersV357Test-1737582895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:43 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:09:43 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Flow 'volume_create_manager' (b252f53c-42e3-4fc1-8649-c9a9781c99df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf7aefc0-31b8-4a88-a23b-8e3e852082a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:43 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d60e7927-98e1-423f-8347-b1ee83b404ba tempest-VolumesTransfersV357Test-1737582895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.316s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-d60e7927-98e1-423f-8347-b1ee83b404ba tempest-VolumesTransfersV357Test-1737582895 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf7aefc0-31b8-4a88-a23b-8e3e852082a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1928080646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d471b5f2-ebdc-4606-b237-1752539c174e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb9cfdeffd94b558c416f31f7ccc3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:43Z,use_quota=True,user_id='cad82280c6cb4566b9ca71131fd46883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cfd5992-0645-42fc-a61a-e2eed74b3c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cfd5992-0645-42fc-a61a-e2eed74b3c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a02ae2-c894-4075-bfcc-24162198b4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a02ae2-c894-4075-bfcc-24162198b4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd471b5f2-ebdc-4606-b237-1752539c174e', 'volume_name': 'volume-d471b5f2-ebdc-4606-b237-1752539c174e', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb1dbdd-f320-46de-bbf9-47abfea4c635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb1dbdd-f320-46de-bbf9-47abfea4c635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e348e50-ae8e-41c8-90ee-be98877b739d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:43 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Volume d471b5f2-ebdc-4606-b237-1752539c174e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d471b5f2-ebdc-4606-b237-1752539c174e', 'volume_size': 1} Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1928080646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d471b5f2-ebdc-4606-b237-1752539c174e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb9cfdeffd94b558c416f31f7ccc3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:43Z,use_quota=True,user_id='cad82280c6cb4566b9ca71131fd46883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Creating volume d471b5f2-ebdc-4606-b237-1752539c174e {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:09:43 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d471b5f2-ebdc-4606-b237-1752539c174e 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:43 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-d60e7927-98e1-423f-8347-b1ee83b404ba tempest-VolumesTransfersV357Test-1737582895 None] Deleted volume successfully. Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d60e7927-98e1-423f-8347-b1ee83b404ba tempest-VolumesTransfersV357Test-1737582895 None] Lock "cinder-4a57e125-6eff-4d57-bf57-3fff723b7505-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:43 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d471b5f2-ebdc-4606-b237-1752539c174e 1073741824 Sep 05 05:09:43 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:43 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d471b5f2-ebdc-4606-b237-1752539c174e 1073741824" returned: 0 in 0.486s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d471b5f2-ebdc-4606-b237-1752539c174e {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:43 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d471b5f2-ebdc-4606-b237-1752539c174e Sep 05 05:09:43 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:44 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d471b5f2-ebdc-4606-b237-1752539c174e" returned: 0 in 0.354s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:44 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:09:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:44 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e348e50-ae8e-41c8-90ee-be98877b739d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d471b5f2-ebdc-4606-b237-1752539c174e', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:44 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6336e08-2236-45f0-bca0-1471d127e815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:44 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Volume volume-d471b5f2-ebdc-4606-b237-1752539c174e (d471b5f2-ebdc-4606-b237-1752539c174e): created successfully Sep 05 05:09:44 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6336e08-2236-45f0-bca0-1471d127e815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:44 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Flow 'volume_create_manager' (b252f53c-42e3-4fc1-8649-c9a9781c99df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:44 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-3a317f24-60ee-4129-a61e-9a1fc8dcbb8a tempest-VolumesTransfersV355Test-173093788 None] Created volume successfully. Sep 05 05:09:45 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:09:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Flow 'volume_create_manager' (4032e9c3-4f92-4a78-bc8f-a4f959bcc5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4234be53-5dde-4efb-b203-465d03e5b2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4234be53-5dde-4efb-b203-465d03e5b2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-990941085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec810484-8354-4db4-95b4-1b5483dc71b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9737385b7db4f0e8df9f77c70a5e0d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:45Z,use_quota=True,user_id='0a6c8dc423344293a5b0f1791f31a563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89927814-e092-4166-a0d4-8c31c8953505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89927814-e092-4166-a0d4-8c31c8953505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19c7bba-e25b-4250-aa18-f7b1eaf34d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19c7bba-e25b-4250-aa18-f7b1eaf34d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec810484-8354-4db4-95b4-1b5483dc71b1', 'volume_name': 'volume-ec810484-8354-4db4-95b4-1b5483dc71b1', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd6fd45-25cf-4380-b24d-aefe27c45c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd6fd45-25cf-4380-b24d-aefe27c45c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b71b4f-9330-40d3-a9a6-99a48f4f3fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:45 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Volume ec810484-8354-4db4-95b4-1b5483dc71b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec810484-8354-4db4-95b4-1b5483dc71b1', 'volume_size': 1} Sep 05 05:09:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:45 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-990941085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec810484-8354-4db4-95b4-1b5483dc71b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9737385b7db4f0e8df9f77c70a5e0d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:45Z,use_quota=True,user_id='0a6c8dc423344293a5b0f1791f31a563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:09:45 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Creating volume ec810484-8354-4db4-95b4-1b5483dc71b1 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:09:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:45 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:45 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:45 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:09:45 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:09:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:45 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1 1073741824 Sep 05 05:09:45 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:46 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1 1073741824" returned: 0 in 0.501s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:46 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1 Sep 05 05:09:46 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:46 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1" returned: 0 in 0.329s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:46 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:09:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b71b4f-9330-40d3-a9a6-99a48f4f3fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec810484-8354-4db4-95b4-1b5483dc71b1', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (449c236d-20a7-4791-b49e-24b6596957ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:46 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Volume volume-ec810484-8354-4db4-95b4-1b5483dc71b1 (ec810484-8354-4db4-95b4-1b5483dc71b1): created successfully Sep 05 05:09:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (449c236d-20a7-4791-b49e-24b6596957ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Flow 'volume_create_manager' (4032e9c3-4f92-4a78-bc8f-a4f959bcc5a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:46 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-2174b78c-6999-4356-a825-d19bea7ac95b tempest-SnapshotMetadataTestJSON-934205770 None] Created volume successfully. Sep 05 05:09:46 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-a3c2893b-6b54-47e5-b141-438ba5971579 tempest-VolumesTransfersV355Test-532103045 None] Transfer volume completed successfully. Sep 05 05:09:47 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-28d92202-32b1-4d24-909e-48efe383cfd6 tempest-VolumesTransfersV355Test-1679550025 None] Acquiring lock "cinder-d471b5f2-ebdc-4606-b237-1752539c174e-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:47 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-28d92202-32b1-4d24-909e-48efe383cfd6 tempest-VolumesTransfersV355Test-1679550025 None] Lock "cinder-d471b5f2-ebdc-4606-b237-1752539c174e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:47 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-28d92202-32b1-4d24-909e-48efe383cfd6 tempest-VolumesTransfersV355Test-1679550025 None] Acquiring lock "cinder-quobyte-d471b5f2-ebdc-4606-b237-1752539c174e" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:47 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-28d92202-32b1-4d24-909e-48efe383cfd6 tempest-VolumesTransfersV355Test-1679550025 None] Lock "cinder-quobyte-d471b5f2-ebdc-4606-b237-1752539c174e" acquired by "delete_volume" :: waited 0.041s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:47 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c73875-4a30-4fa3-9968-3ec941150c2e]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-28d92202-32b1-4d24-909e-48efe383cfd6 tempest-VolumesTransfersV355Test-1679550025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d471b5f2-ebdc-4606-b237-1752539c174e {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-18c395d1-bc5b-41dd-8eeb-1b01f1a58a28 tempest-SnapshotMetadataTestJSON-934205770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-18c395d1-bc5b-41dd-8eeb-1b01f1a58a28 tempest-SnapshotMetadataTestJSON-934205770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-18c395d1-bc5b-41dd-8eeb-1b01f1a58a28 tempest-SnapshotMetadataTestJSON-934205770 None] Creating offline snapshot fa8bde89-9bc0-4875-826d-fea3baac6a7a of volume ec810484-8354-4db4-95b4-1b5483dc71b1 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:09:47 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f3dd1b-7475-47ba-bee6-dd08b42295ba]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-18c395d1-bc5b-41dd-8eeb-1b01f1a58a28 tempest-SnapshotMetadataTestJSON-934205770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:47 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d471b5f2-ebdc-4606-b237-1752539c174e Sep 05 05:09:47 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:48 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1 Sep 05 05:09:48 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:48 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-28d92202-32b1-4d24-909e-48efe383cfd6 tempest-VolumesTransfersV355Test-1679550025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d471b5f2-ebdc-4606-b237-1752539c174e" returned: 0 in 0.476s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-28d92202-32b1-4d24-909e-48efe383cfd6 tempest-VolumesTransfersV355Test-1679550025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d471b5f2-ebdc-4606-b237-1752539c174e {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:48 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d471b5f2-ebdc-4606-b237-1752539c174e Sep 05 05:09:48 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:48 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-18c395d1-bc5b-41dd-8eeb-1b01f1a58a28 tempest-SnapshotMetadataTestJSON-934205770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1" returned: 0 in 0.519s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-18c395d1-bc5b-41dd-8eeb-1b01f1a58a28 tempest-SnapshotMetadataTestJSON-934205770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.fa8bde89-9bc0-4875-826d-fea3baac6a7a 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:48 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.fa8bde89-9bc0-4875-826d-fea3baac6a7a 1G Sep 05 05:09:48 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:48 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-28d92202-32b1-4d24-909e-48efe383cfd6 tempest-VolumesTransfersV355Test-1679550025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d471b5f2-ebdc-4606-b237-1752539c174e" returned: 0 in 0.275s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-28d92202-32b1-4d24-909e-48efe383cfd6 tempest-VolumesTransfersV355Test-1679550025 None] Lock "cinder-quobyte-d471b5f2-ebdc-4606-b237-1752539c174e" released by "delete_volume" :: held 0.804s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:48 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-28d92202-32b1-4d24-909e-48efe383cfd6 tempest-VolumesTransfersV355Test-1679550025 None] Created reservations ['173ebf8e-6f22-4ac8-88c5-75bcf39c288b', 'cf26637d-b0f3-4fb6-9b01-4ae22b90ec32', '4fe3f7e0-5940-4605-9866-7b3042a4ce41', '3c9908b4-f671-40f7-a0fd-1accf382fcec'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:09:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-28d92202-32b1-4d24-909e-48efe383cfd6 tempest-VolumesTransfersV355Test-1679550025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-28d92202-32b1-4d24-909e-48efe383cfd6 tempest-VolumesTransfersV355Test-1679550025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-28d92202-32b1-4d24-909e-48efe383cfd6 tempest-VolumesTransfersV355Test-1679550025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-28d92202-32b1-4d24-909e-48efe383cfd6 tempest-VolumesTransfersV355Test-1679550025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-28d92202-32b1-4d24-909e-48efe383cfd6 tempest-VolumesTransfersV355Test-1679550025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-28d92202-32b1-4d24-909e-48efe383cfd6 tempest-VolumesTransfersV355Test-1679550025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:48 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:09:48 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:49 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-18c395d1-bc5b-41dd-8eeb-1b01f1a58a28 tempest-SnapshotMetadataTestJSON-934205770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.fa8bde89-9bc0-4875-826d-fea3baac6a7a 1G" returned: 0 in 0.620s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-18c395d1-bc5b-41dd-8eeb-1b01f1a58a28 tempest-SnapshotMetadataTestJSON-934205770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec810484-8354-4db4-95b4-1b5483dc71b1 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.fa8bde89-9bc0-4875-826d-fea3baac6a7a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:49 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec810484-8354-4db4-95b4-1b5483dc71b1 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.fa8bde89-9bc0-4875-826d-fea3baac6a7a Sep 05 05:09:49 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:49 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-28d92202-32b1-4d24-909e-48efe383cfd6 tempest-VolumesTransfersV355Test-1679550025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.397s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-28d92202-32b1-4d24-909e-48efe383cfd6 tempest-VolumesTransfersV355Test-1679550025 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:09:49 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-28d92202-32b1-4d24-909e-48efe383cfd6 tempest-VolumesTransfersV355Test-1679550025 None] Deleted volume successfully. Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-28d92202-32b1-4d24-909e-48efe383cfd6 tempest-VolumesTransfersV355Test-1679550025 None] Lock "cinder-d471b5f2-ebdc-4606-b237-1752539c174e-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:49 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-18c395d1-bc5b-41dd-8eeb-1b01f1a58a28 tempest-SnapshotMetadataTestJSON-934205770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec810484-8354-4db4-95b4-1b5483dc71b1 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.fa8bde89-9bc0-4875-826d-fea3baac6a7a" returned: 0 in 0.410s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:49 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-18c395d1-bc5b-41dd-8eeb-1b01f1a58a28 tempest-SnapshotMetadataTestJSON-934205770 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.fa8bde89-9bc0-4875-826d-fea3baac6a7a is being set with open permissions: ugo+rw Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-18c395d1-bc5b-41dd-8eeb-1b01f1a58a28 tempest-SnapshotMetadataTestJSON-934205770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.fa8bde89-9bc0-4875-826d-fea3baac6a7a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:49 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.fa8bde89-9bc0-4875-826d-fea3baac6a7a Sep 05 05:09:49 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:49 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:09:49 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Flow 'volume_create_manager' (ab9abcd8-219a-4fdd-9363-49a6c550e0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef54dc48-33ef-42f0-b02c-3b8a7410d401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:49 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-18c395d1-bc5b-41dd-8eeb-1b01f1a58a28 tempest-SnapshotMetadataTestJSON-934205770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.fa8bde89-9bc0-4875-826d-fea3baac6a7a" returned: 0 in 0.392s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef54dc48-33ef-42f0-b02c-3b8a7410d401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1901205424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa58bea6-363c-4d84-8153-3711a7fdb518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb9cfdeffd94b558c416f31f7ccc3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:50Z,use_quota=True,user_id='cad82280c6cb4566b9ca71131fd46883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a19f4f-e8f6-4990-8ea2-8aad271bd850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a19f4f-e8f6-4990-8ea2-8aad271bd850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02016f4-1a9d-4f35-a859-c42ef60b47a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02016f4-1a9d-4f35-a859-c42ef60b47a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa58bea6-363c-4d84-8153-3711a7fdb518', 'volume_name': 'volume-aa58bea6-363c-4d84-8153-3711a7fdb518', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530bcdd7-239d-4ff5-a500-894e9099de2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530bcdd7-239d-4ff5-a500-894e9099de2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eae445f-6e7e-428e-be0b-d6b14c344df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:49 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Volume aa58bea6-363c-4d84-8153-3711a7fdb518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa58bea6-363c-4d84-8153-3711a7fdb518', 'volume_size': 1} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-18c395d1-bc5b-41dd-8eeb-1b01f1a58a28 tempest-SnapshotMetadataTestJSON-934205770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:49 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.347s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager._thread_info {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread count: 28 {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 05:09:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread info: [<_MainThread(MainThread, started 139182109970560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 05:09:49 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.info Sep 05 05:09:49 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:50 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-18c395d1-bc5b-41dd-8eeb-1b01f1a58a28 tempest-SnapshotMetadataTestJSON-934205770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.info" returned: 0 in 0.269s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:50 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-18c395d1-bc5b-41dd-8eeb-1b01f1a58a28 tempest-SnapshotMetadataTestJSON-934205770 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.info is being set with open permissions: ugo+rw Sep 05 05:09:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-18c395d1-bc5b-41dd-8eeb-1b01f1a58a28 tempest-SnapshotMetadataTestJSON-934205770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:50 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.info Sep 05 05:09:50 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:50 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-18c395d1-bc5b-41dd-8eeb-1b01f1a58a28 tempest-SnapshotMetadataTestJSON-934205770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.info" returned: 0 in 0.248s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-18c395d1-bc5b-41dd-8eeb-1b01f1a58a28 tempest-SnapshotMetadataTestJSON-934205770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.629s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.580s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1901205424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa58bea6-363c-4d84-8153-3711a7fdb518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb9cfdeffd94b558c416f31f7ccc3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:50Z,use_quota=True,user_id='cad82280c6cb4566b9ca71131fd46883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:09:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Creating volume aa58bea6-363c-4d84-8153-3711a7fdb518 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:09:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:09:50 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:09:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-aa58bea6-363c-4d84-8153-3711a7fdb518 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:50 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-aa58bea6-363c-4d84-8153-3711a7fdb518 1073741824 Sep 05 05:09:50 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:50 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-18c395d1-bc5b-41dd-8eeb-1b01f1a58a28 tempest-SnapshotMetadataTestJSON-934205770 None] Create snapshot completed successfully Sep 05 05:09:50 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-aa58bea6-363c-4d84-8153-3711a7fdb518 1073741824" returned: 0 in 0.487s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-aa58bea6-363c-4d84-8153-3711a7fdb518 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:51 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-aa58bea6-363c-4d84-8153-3711a7fdb518 Sep 05 05:09:51 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:51 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-aa58bea6-363c-4d84-8153-3711a7fdb518" returned: 0 in 0.277s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:09:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eae445f-6e7e-428e-be0b-d6b14c344df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa58bea6-363c-4d84-8153-3711a7fdb518', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38222f36-65fe-4fc3-8a4e-6fe1361e4280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:51 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Volume volume-aa58bea6-363c-4d84-8153-3711a7fdb518 (aa58bea6-363c-4d84-8153-3711a7fdb518): created successfully Sep 05 05:09:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38222f36-65fe-4fc3-8a4e-6fe1361e4280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Flow 'volume_create_manager' (ab9abcd8-219a-4fdd-9363-49a6c550e0db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:51 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-cbee05eb-4513-4c50-8c5b-308888e75942 tempest-VolumesTransfersV355Test-173093788 None] Created volume successfully. Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Flow 'volume_create_manager' (0448186d-a63c-41a9-93e6-8efa9b08ca2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (055c6d11-2b1a-4a59-9417-1fd27d59df85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (055c6d11-2b1a-4a59-9417-1fd27d59df85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-44815843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d36857-69b0-4665-a907-fe6a5c844ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a64772e20e84f0aabec652992234d44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:52Z,use_quota=True,user_id='c9f2beabdc6c42dea8626bc8471a58d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e093a329-f0b6-4070-a2fd-397393675119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e093a329-f0b6-4070-a2fd-397393675119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e31affd-b9f9-47b9-a153-1fe078c99dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e31affd-b9f9-47b9-a153-1fe078c99dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d36857-69b0-4665-a907-fe6a5c844ede', 'volume_name': 'volume-36d36857-69b0-4665-a907-fe6a5c844ede', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a650ec5-b2cc-4f49-9268-cb1d0cef8226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a650ec5-b2cc-4f49-9268-cb1d0cef8226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af07569-995e-47b2-830e-5ee754c73120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:52 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Volume 36d36857-69b0-4665-a907-fe6a5c844ede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d36857-69b0-4665-a907-fe6a5c844ede', 'volume_size': 1} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-44815843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d36857-69b0-4665-a907-fe6a5c844ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a64772e20e84f0aabec652992234d44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:52Z,use_quota=True,user_id='c9f2beabdc6c42dea8626bc8471a58d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Creating volume 36d36857-69b0-4665-a907-fe6a5c844ede {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:09:52 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0210e883-5ee5-4bbf-8284-c31db696ef12 tempest-SnapshotMetadataTestJSON-934205770 None] Acquiring lock "cinder-fa8bde89-9bc0-4875-826d-fea3baac6a7a-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:52 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede 1073741824 Sep 05 05:09:52 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0210e883-5ee5-4bbf-8284-c31db696ef12 tempest-SnapshotMetadataTestJSON-934205770 None] Lock "cinder-fa8bde89-9bc0-4875-826d-fea3baac6a7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0210e883-5ee5-4bbf-8284-c31db696ef12 tempest-SnapshotMetadataTestJSON-934205770 None] Acquiring lock "cinder-quobyte-ec810484-8354-4db4-95b4-1b5483dc71b1" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0210e883-5ee5-4bbf-8284-c31db696ef12 tempest-SnapshotMetadataTestJSON-934205770 None] Lock "cinder-quobyte-ec810484-8354-4db4-95b4-1b5483dc71b1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0210e883-5ee5-4bbf-8284-c31db696ef12 tempest-SnapshotMetadataTestJSON-934205770 None] Acquiring lock "cinder-quobyte-fa8bde89-9bc0-4875-826d-fea3baac6a7a" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0210e883-5ee5-4bbf-8284-c31db696ef12 tempest-SnapshotMetadataTestJSON-934205770 None] Lock "cinder-quobyte-fa8bde89-9bc0-4875-826d-fea3baac6a7a" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-0210e883-5ee5-4bbf-8284-c31db696ef12 tempest-SnapshotMetadataTestJSON-934205770 None] Deleting offline snapshot fa8bde89-9bc0-4875-826d-fea3baac6a7a of volume ec810484-8354-4db4-95b4-1b5483dc71b1 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-0210e883-5ee5-4bbf-8284-c31db696ef12 tempest-SnapshotMetadataTestJSON-934205770 None] snapshot_file for this snap is: volume-ec810484-8354-4db4-95b4-1b5483dc71b1.fa8bde89-9bc0-4875-826d-fea3baac6a7a {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8c00ab67-cd87-4c20-87bc-708be726fa95 tempest-VolumesTransfersV355Test-1679550025 None] Acquiring lock "cinder-aa58bea6-363c-4d84-8153-3711a7fdb518-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1ed60f-00ca-4b8f-a1b1-2f70f2b68558]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0210e883-5ee5-4bbf-8284-c31db696ef12 tempest-SnapshotMetadataTestJSON-934205770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.fa8bde89-9bc0-4875-826d-fea3baac6a7a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8c00ab67-cd87-4c20-87bc-708be726fa95 tempest-VolumesTransfersV355Test-1679550025 None] Lock "cinder-aa58bea6-363c-4d84-8153-3711a7fdb518-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8c00ab67-cd87-4c20-87bc-708be726fa95 tempest-VolumesTransfersV355Test-1679550025 None] Acquiring lock "cinder-quobyte-aa58bea6-363c-4d84-8153-3711a7fdb518" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8c00ab67-cd87-4c20-87bc-708be726fa95 tempest-VolumesTransfersV355Test-1679550025 None] Lock "cinder-quobyte-aa58bea6-363c-4d84-8153-3711a7fdb518" acquired by "delete_volume" :: waited 0.019s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b5e6c9-0018-47fa-a57e-a3e0d8e16649]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8c00ab67-cd87-4c20-87bc-708be726fa95 tempest-VolumesTransfersV355Test-1679550025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-aa58bea6-363c-4d84-8153-3711a7fdb518 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:52 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.fa8bde89-9bc0-4875-826d-fea3baac6a7a Sep 05 05:09:52 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:52 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-aa58bea6-363c-4d84-8153-3711a7fdb518 Sep 05 05:09:52 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:52 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede 1073741824" returned: 0 in 0.543s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:52 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede Sep 05 05:09:52 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:52 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0210e883-5ee5-4bbf-8284-c31db696ef12 tempest-SnapshotMetadataTestJSON-934205770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.fa8bde89-9bc0-4875-826d-fea3baac6a7a" returned: 0 in 0.446s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-0210e883-5ee5-4bbf-8284-c31db696ef12 tempest-SnapshotMetadataTestJSON-934205770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec810484-8354-4db4-95b4-1b5483dc71b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7ae26d-2b21-43b3-85c4-3ca5690562e0]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0210e883-5ee5-4bbf-8284-c31db696ef12 tempest-SnapshotMetadataTestJSON-934205770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:53 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8c00ab67-cd87-4c20-87bc-708be726fa95 tempest-VolumesTransfersV355Test-1679550025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-aa58bea6-363c-4d84-8153-3711a7fdb518" returned: 0 in 0.470s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8c00ab67-cd87-4c20-87bc-708be726fa95 tempest-VolumesTransfersV355Test-1679550025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-aa58bea6-363c-4d84-8153-3711a7fdb518 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:53 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1 Sep 05 05:09:53 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:53 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-aa58bea6-363c-4d84-8153-3711a7fdb518 Sep 05 05:09:53 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:53 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede" returned: 0 in 0.339s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af07569-995e-47b2-830e-5ee754c73120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d36857-69b0-4665-a907-fe6a5c844ede', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca16eee-e14e-4c72-96d5-9c636e78b66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:53 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Volume volume-36d36857-69b0-4665-a907-fe6a5c844ede (36d36857-69b0-4665-a907-fe6a5c844ede): created successfully Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca16eee-e14e-4c72-96d5-9c636e78b66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Flow 'volume_create_manager' (0448186d-a63c-41a9-93e6-8efa9b08ca2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:53 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-e34227ae-be4e-4af0-ad15-09e374275810 tempest-VolumesDeleteCascade-1299616072 None] Created volume successfully. Sep 05 05:09:53 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8c00ab67-cd87-4c20-87bc-708be726fa95 tempest-VolumesTransfersV355Test-1679550025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-aa58bea6-363c-4d84-8153-3711a7fdb518" returned: 0 in 0.360s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8c00ab67-cd87-4c20-87bc-708be726fa95 tempest-VolumesTransfersV355Test-1679550025 None] Lock "cinder-quobyte-aa58bea6-363c-4d84-8153-3711a7fdb518" released by "delete_volume" :: held 0.880s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:53 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0210e883-5ee5-4bbf-8284-c31db696ef12 tempest-SnapshotMetadataTestJSON-934205770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1" returned: 0 in 0.508s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0210e883-5ee5-4bbf-8284-c31db696ef12 tempest-SnapshotMetadataTestJSON-934205770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.fa8bde89-9bc0-4875-826d-fea3baac6a7a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:53 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.fa8bde89-9bc0-4875-826d-fea3baac6a7a Sep 05 05:09:53 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-8c00ab67-cd87-4c20-87bc-708be726fa95 tempest-VolumesTransfersV355Test-1679550025 None] Created reservations ['5006f0c6-564c-48e0-ace2-a456366ecf19', 'b6f54c9f-e3ec-482a-8f22-5ca9cfc31dae', '7d7e7e6b-a1cb-463e-93d9-bc3cdbafcbc1', 'f703df9b-414e-4de0-ac1f-15687fb2b244'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8c00ab67-cd87-4c20-87bc-708be726fa95 tempest-VolumesTransfersV355Test-1679550025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8c00ab67-cd87-4c20-87bc-708be726fa95 tempest-VolumesTransfersV355Test-1679550025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8c00ab67-cd87-4c20-87bc-708be726fa95 tempest-VolumesTransfersV355Test-1679550025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8c00ab67-cd87-4c20-87bc-708be726fa95 tempest-VolumesTransfersV355Test-1679550025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8c00ab67-cd87-4c20-87bc-708be726fa95 tempest-VolumesTransfersV355Test-1679550025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8c00ab67-cd87-4c20-87bc-708be726fa95 tempest-VolumesTransfersV355Test-1679550025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:53 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:09:53 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:53 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0210e883-5ee5-4bbf-8284-c31db696ef12 tempest-SnapshotMetadataTestJSON-934205770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.fa8bde89-9bc0-4875-826d-fea3baac6a7a" returned: 0 in 0.399s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0210e883-5ee5-4bbf-8284-c31db696ef12 tempest-SnapshotMetadataTestJSON-934205770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.fa8bde89-9bc0-4875-826d-fea3baac6a7a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:53 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8c00ab67-cd87-4c20-87bc-708be726fa95 tempest-VolumesTransfersV355Test-1679550025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.282s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-8c00ab67-cd87-4c20-87bc-708be726fa95 tempest-VolumesTransfersV355Test-1679550025 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:09:53 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-8c00ab67-cd87-4c20-87bc-708be726fa95 tempest-VolumesTransfersV355Test-1679550025 None] Deleted volume successfully. Sep 05 05:09:53 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.fa8bde89-9bc0-4875-826d-fea3baac6a7a Sep 05 05:09:53 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:53 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8c00ab67-cd87-4c20-87bc-708be726fa95 tempest-VolumesTransfersV355Test-1679550025 None] Lock "cinder-aa58bea6-363c-4d84-8153-3711a7fdb518-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:54 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0210e883-5ee5-4bbf-8284-c31db696ef12 tempest-SnapshotMetadataTestJSON-934205770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1.fa8bde89-9bc0-4875-826d-fea3baac6a7a" returned: 0 in 0.282s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0210e883-5ee5-4bbf-8284-c31db696ef12 tempest-SnapshotMetadataTestJSON-934205770 None] Lock "cinder-quobyte-fa8bde89-9bc0-4875-826d-fea3baac6a7a" released by "_delete_snapshot" :: held 1.829s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0210e883-5ee5-4bbf-8284-c31db696ef12 tempest-SnapshotMetadataTestJSON-934205770 None] Lock "cinder-quobyte-ec810484-8354-4db4-95b4-1b5483dc71b1" released by "delete_snapshot" :: held 1.870s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:54 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-0210e883-5ee5-4bbf-8284-c31db696ef12 tempest-SnapshotMetadataTestJSON-934205770 None] Created reservations ['6df3d120-c06e-4e6a-9cb4-9fc39f26737c', '7c8eef99-9e51-4ed6-a6ab-9bcd9f75f037', '0dcf174e-f21e-48d6-97b0-f24f63a2e2ab', '7ea0bcc2-e9a4-4906-87bd-b7ff166c3401'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:09:54 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-0210e883-5ee5-4bbf-8284-c31db696ef12 tempest-SnapshotMetadataTestJSON-934205770 None] Delete snapshot completed successfully. Sep 05 05:09:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0210e883-5ee5-4bbf-8284-c31db696ef12 tempest-SnapshotMetadataTestJSON-934205770 None] Lock "cinder-fa8bde89-9bc0-4875-826d-fea3baac6a7a-delete_snapshot" released by "delete_snapshot" :: held 2.081s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8d42200c-a270-43aa-b845-2d8784e0f8cf tempest-SnapshotMetadataTestJSON-934205770 None] Acquiring lock "cinder-ec810484-8354-4db4-95b4-1b5483dc71b1-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1f34fbb2-10ea-4068-a2a8-d577d6777b73 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1f34fbb2-10ea-4068-a2a8-d577d6777b73 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8d42200c-a270-43aa-b845-2d8784e0f8cf tempest-SnapshotMetadataTestJSON-934205770 None] Lock "cinder-ec810484-8354-4db4-95b4-1b5483dc71b1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-1f34fbb2-10ea-4068-a2a8-d577d6777b73 tempest-VolumesDeleteCascade-1299616072 None] Creating offline snapshot a54eff9c-106f-4790-bc09-e4660d6e51f0 of volume 36d36857-69b0-4665-a907-fe6a5c844ede {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:09:54 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cac222-dd19-4b10-b6f5-09f2c6d0abe0]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f34fbb2-10ea-4068-a2a8-d577d6777b73 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8d42200c-a270-43aa-b845-2d8784e0f8cf tempest-SnapshotMetadataTestJSON-934205770 None] Acquiring lock "cinder-quobyte-ec810484-8354-4db4-95b4-1b5483dc71b1" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:09:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8d42200c-a270-43aa-b845-2d8784e0f8cf tempest-SnapshotMetadataTestJSON-934205770 None] Lock "cinder-quobyte-ec810484-8354-4db4-95b4-1b5483dc71b1" acquired by "delete_volume" :: waited 0.027s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:09:54 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e379431-e457-41d9-b769-c64ed7502d71]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8d42200c-a270-43aa-b845-2d8784e0f8cf tempest-SnapshotMetadataTestJSON-934205770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:54 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede Sep 05 05:09:54 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:54 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1 Sep 05 05:09:54 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:55 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f34fbb2-10ea-4068-a2a8-d577d6777b73 tempest-VolumesDeleteCascade-1299616072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede" returned: 0 in 0.427s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f34fbb2-10ea-4068-a2a8-d577d6777b73 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:55 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0 1G Sep 05 05:09:55 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:55 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8d42200c-a270-43aa-b845-2d8784e0f8cf tempest-SnapshotMetadataTestJSON-934205770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1" returned: 0 in 0.445s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8d42200c-a270-43aa-b845-2d8784e0f8cf tempest-SnapshotMetadataTestJSON-934205770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:55 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1 Sep 05 05:09:55 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8d42200c-a270-43aa-b845-2d8784e0f8cf tempest-SnapshotMetadataTestJSON-934205770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec810484-8354-4db4-95b4-1b5483dc71b1" returned: 0 in 0.300s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:55 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:55 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8d42200c-a270-43aa-b845-2d8784e0f8cf tempest-SnapshotMetadataTestJSON-934205770 None] Lock "cinder-quobyte-ec810484-8354-4db4-95b4-1b5483dc71b1" released by "delete_volume" :: held 0.822s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:55 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f34fbb2-10ea-4068-a2a8-d577d6777b73 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0 1G" returned: 0 in 0.498s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f34fbb2-10ea-4068-a2a8-d577d6777b73 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36d36857-69b0-4665-a907-fe6a5c844ede -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:55 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-8d42200c-a270-43aa-b845-2d8784e0f8cf tempest-SnapshotMetadataTestJSON-934205770 None] Created reservations ['58eb10c6-d18a-4498-88ce-b54834ea3774', '51538cb1-dd5b-41fc-85a7-89b8b9bc70eb', 'bb912951-1e87-4d6f-b1ee-3bf095a65445', 'a63973fc-0074-4bc1-b1d2-80b322f40514'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:09:55 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36d36857-69b0-4665-a907-fe6a5c844ede -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0 Sep 05 05:09:55 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8d42200c-a270-43aa-b845-2d8784e0f8cf tempest-SnapshotMetadataTestJSON-934205770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8d42200c-a270-43aa-b845-2d8784e0f8cf tempest-SnapshotMetadataTestJSON-934205770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8d42200c-a270-43aa-b845-2d8784e0f8cf tempest-SnapshotMetadataTestJSON-934205770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8d42200c-a270-43aa-b845-2d8784e0f8cf tempest-SnapshotMetadataTestJSON-934205770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8d42200c-a270-43aa-b845-2d8784e0f8cf tempest-SnapshotMetadataTestJSON-934205770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8d42200c-a270-43aa-b845-2d8784e0f8cf tempest-SnapshotMetadataTestJSON-934205770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:55 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:09:55 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:55 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f34fbb2-10ea-4068-a2a8-d577d6777b73 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36d36857-69b0-4665-a907-fe6a5c844ede -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0" returned: 0 in 0.378s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:56 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-1f34fbb2-10ea-4068-a2a8-d577d6777b73 tempest-VolumesDeleteCascade-1299616072 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0 is being set with open permissions: ugo+rw Sep 05 05:09:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f34fbb2-10ea-4068-a2a8-d577d6777b73 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:56 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0 Sep 05 05:09:56 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:56 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8d42200c-a270-43aa-b845-2d8784e0f8cf tempest-SnapshotMetadataTestJSON-934205770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.314s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:56 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-8d42200c-a270-43aa-b845-2d8784e0f8cf tempest-SnapshotMetadataTestJSON-934205770 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:09:56 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-8d42200c-a270-43aa-b845-2d8784e0f8cf tempest-SnapshotMetadataTestJSON-934205770 None] Deleted volume successfully. Sep 05 05:09:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8d42200c-a270-43aa-b845-2d8784e0f8cf tempest-SnapshotMetadataTestJSON-934205770 None] Lock "cinder-ec810484-8354-4db4-95b4-1b5483dc71b1-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:09:56 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f34fbb2-10ea-4068-a2a8-d577d6777b73 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0" returned: 0 in 0.289s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f34fbb2-10ea-4068-a2a8-d577d6777b73 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:56 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.info Sep 05 05:09:56 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:56 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f34fbb2-10ea-4068-a2a8-d577d6777b73 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.info" returned: 0 in 0.308s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:56 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-1f34fbb2-10ea-4068-a2a8-d577d6777b73 tempest-VolumesDeleteCascade-1299616072 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.info is being set with open permissions: ugo+rw Sep 05 05:09:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f34fbb2-10ea-4068-a2a8-d577d6777b73 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:56 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.info Sep 05 05:09:56 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:56 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f34fbb2-10ea-4068-a2a8-d577d6777b73 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.info" returned: 0 in 0.280s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1f34fbb2-10ea-4068-a2a8-d577d6777b73 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.322s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:57 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-1f34fbb2-10ea-4068-a2a8-d577d6777b73 tempest-VolumesDeleteCascade-1299616072 None] Create snapshot completed successfully Sep 05 05:09:57 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:09:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Flow 'volume_create_manager' (feaae642-07fa-43e9-b821-283b390ea443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16fe5b42-0cc5-43d1-9d39-7a4c65872fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16fe5b42-0cc5-43d1-9d39-7a4c65872fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2031571842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944cace7-43c4-4f25-ba6e-3e23c5192db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1246940b9e8d4ce698da27500abca704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:57Z,use_quota=True,user_id='d9c3312ba4034acf805c40f951b06f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ffaa60-da91-4bad-8965-5a7054639351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ffaa60-da91-4bad-8965-5a7054639351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f07e6d8-017c-443d-8850-5bfd496f1eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f07e6d8-017c-443d-8850-5bfd496f1eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '944cace7-43c4-4f25-ba6e-3e23c5192db8', 'volume_name': 'volume-944cace7-43c4-4f25-ba6e-3e23c5192db8', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed818393-bd49-4944-86fc-ff54036c22ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed818393-bd49-4944-86fc-ff54036c22ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (547ca39e-966e-4d8c-99b4-9508e9cbd4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:57 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Volume 944cace7-43c4-4f25-ba6e-3e23c5192db8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-944cace7-43c4-4f25-ba6e-3e23c5192db8', 'volume_size': 1} Sep 05 05:09:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2031571842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944cace7-43c4-4f25-ba6e-3e23c5192db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1246940b9e8d4ce698da27500abca704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:09:57Z,use_quota=True,user_id='d9c3312ba4034acf805c40f951b06f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:09:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Creating volume 944cace7-43c4-4f25-ba6e-3e23c5192db8 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:09:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:09:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:09:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:09:57 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:09:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:57 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8 1073741824 Sep 05 05:09:57 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:57 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8 1073741824" returned: 0 in 0.583s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-bdff094f-0120-412d-8546-17179495c456 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:58 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8 Sep 05 05:09:58 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:58 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8" returned: 0 in 0.278s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:09:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:09:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-bdff094f-0120-412d-8546-17179495c456 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.292s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:09:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (547ca39e-966e-4d8c-99b4-9508e9cbd4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-944cace7-43c4-4f25-ba6e-3e23c5192db8', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a40b831-c229-4c60-8ba8-a5ed7c69a870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:09:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-bdff094f-0120-412d-8546-17179495c456 tempest-VolumesDeleteCascade-1299616072 None] Creating offline snapshot f2843aa7-58db-4f94-955e-2952a6cae58a of volume 36d36857-69b0-4665-a907-fe6a5c844ede {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:09:58 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Volume volume-944cace7-43c4-4f25-ba6e-3e23c5192db8 (944cace7-43c4-4f25-ba6e-3e23c5192db8): created successfully Sep 05 05:09:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a40b831-c229-4c60-8ba8-a5ed7c69a870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:09:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Flow 'volume_create_manager' (feaae642-07fa-43e9-b821-283b390ea443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:09:58 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[863ca9e6-7c3d-408f-8255-10dfa276bd6d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:09:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bdff094f-0120-412d-8546-17179495c456 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:58 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-52fdf843-ef40-45c1-9163-6659fc01cfda tempest-VolumesSnapshotListTestJSON-728014487 None] Created volume successfully. Sep 05 05:09:58 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0 Sep 05 05:09:58 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:58 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bdff094f-0120-412d-8546-17179495c456 tempest-VolumesDeleteCascade-1299616072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0" returned: 0 in 0.421s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-bdff094f-0120-412d-8546-17179495c456 tempest-VolumesDeleteCascade-1299616072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36d36857-69b0-4665-a907-fe6a5c844ede(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:09:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bdff094f-0120-412d-8546-17179495c456 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:58 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a 1G Sep 05 05:09:58 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:59 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bdff094f-0120-412d-8546-17179495c456 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a 1G" returned: 0 in 0.602s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bdff094f-0120-412d-8546-17179495c456 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:59 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a Sep 05 05:09:59 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:09:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6f9f355f-44bb-4cd9-b157-4c1085b163e8 tempest-VolumesSnapshotListTestJSON-728014487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:09:59 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Sep 05 05:09:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bdff094f-0120-412d-8546-17179495c456 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a" returned: 0 in 0.428s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:09:59 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-bdff094f-0120-412d-8546-17179495c456 tempest-VolumesDeleteCascade-1299616072 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a is being set with open permissions: ugo+rw Sep 05 05:09:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bdff094f-0120-412d-8546-17179495c456 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:09:59 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a Sep 05 05:09:59 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:00 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bdff094f-0120-412d-8546-17179495c456 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a" returned: 0 in 0.276s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-bdff094f-0120-412d-8546-17179495c456 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.871s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6f9f355f-44bb-4cd9-b157-4c1085b163e8 tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.568s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:00 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-6f9f355f-44bb-4cd9-b157-4c1085b163e8 tempest-VolumesSnapshotListTestJSON-728014487 None] Creating offline snapshot 9352d2e4-f1df-4514-a57c-045ff2978402 of volume 944cace7-43c4-4f25-ba6e-3e23c5192db8 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:10:00 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-bdff094f-0120-412d-8546-17179495c456 tempest-VolumesDeleteCascade-1299616072 None] Create snapshot completed successfully Sep 05 05:10:00 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7556380-29f8-412f-97da-624a99030e06]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6f9f355f-44bb-4cd9-b157-4c1085b163e8 tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:00 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8 Sep 05 05:10:00 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:00 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6f9f355f-44bb-4cd9-b157-4c1085b163e8 tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8" returned: 0 in 0.426s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6f9f355f-44bb-4cd9-b157-4c1085b163e8 tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:00 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402 1G Sep 05 05:10:00 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:01 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6f9f355f-44bb-4cd9-b157-4c1085b163e8 tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402 1G" returned: 0 in 0.464s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6f9f355f-44bb-4cd9-b157-4c1085b163e8 tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-944cace7-43c4-4f25-ba6e-3e23c5192db8 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:01 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-944cace7-43c4-4f25-ba6e-3e23c5192db8 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402 Sep 05 05:10:01 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "cinder-36d36857-69b0-4665-a907-fe6a5c844ede-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-36d36857-69b0-4665-a907-fe6a5c844ede-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Performing cascade delete. {{(pid=89331) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "cinder-a54eff9c-106f-4790-bc09-e4660d6e51f0-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-a54eff9c-106f-4790-bc09-e4660d6e51f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "cinder-quobyte-36d36857-69b0-4665-a907-fe6a5c844ede" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-quobyte-36d36857-69b0-4665-a907-fe6a5c844ede" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "cinder-quobyte-a54eff9c-106f-4790-bc09-e4660d6e51f0" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-quobyte-a54eff9c-106f-4790-bc09-e4660d6e51f0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Deleting offline snapshot a54eff9c-106f-4790-bc09-e4660d6e51f0 of volume 36d36857-69b0-4665-a907-fe6a5c844ede {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] snapshot_file for this snap is: volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[81aacd6b-404e-4acb-88e4-246bb06b41d1]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:01 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6f9f355f-44bb-4cd9-b157-4c1085b163e8 tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-944cace7-43c4-4f25-ba6e-3e23c5192db8 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402" returned: 0 in 0.435s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:01 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-6f9f355f-44bb-4cd9-b157-4c1085b163e8 tempest-VolumesSnapshotListTestJSON-728014487 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402 is being set with open permissions: ugo+rw Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6f9f355f-44bb-4cd9-b157-4c1085b163e8 tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:01 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402 Sep 05 05:10:01 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Flow 'volume_create_manager' (720fbcc6-8aac-4195-b332-c2fd5d8bcb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:01 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0 Sep 05 05:10:01 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b785ab73-464c-414a-88f3-a88146e8e883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b785ab73-464c-414a-88f3-a88146e8e883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-204654038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9472aa39-841e-4732-a0b9-fcd6b4056aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e060f41985ef42ed984fef4a33a9e70c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:02Z,use_quota=True,user_id='e3aeed1643d546498fe1a9337084f28b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70f1d330-a4df-4f06-adc8-a9df6fbe0a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70f1d330-a4df-4f06-adc8-a9df6fbe0a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404a982c-43e6-487f-a83f-0f73c63b312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404a982c-43e6-487f-a83f-0f73c63b312d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9472aa39-841e-4732-a0b9-fcd6b4056aad', 'volume_name': 'volume-9472aa39-841e-4732-a0b9-fcd6b4056aad', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69cab337-dd48-44ea-bb2b-1b1728418db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69cab337-dd48-44ea-bb2b-1b1728418db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaec5bd8-c53e-4012-b511-618171c7d993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:01 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Volume 9472aa39-841e-4732-a0b9-fcd6b4056aad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9472aa39-841e-4732-a0b9-fcd6b4056aad', 'volume_size': 1} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:01 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6f9f355f-44bb-4cd9-b157-4c1085b163e8 tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402" returned: 0 in 0.306s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6f9f355f-44bb-4cd9-b157-4c1085b163e8 tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:01 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:01 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.info Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0" returned: 0 in 0.438s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:01 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36d36857-69b0-4665-a907-fe6a5c844ede(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d547fd2b-44a4-47bf-961a-3333a5233f03]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:02 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede Sep 05 05:10:02 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:02 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6f9f355f-44bb-4cd9-b157-4c1085b163e8 tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.info" returned: 0 in 0.269s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:02 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-6f9f355f-44bb-4cd9-b157-4c1085b163e8 tempest-VolumesSnapshotListTestJSON-728014487 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.info is being set with open permissions: ugo+rw Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6f9f355f-44bb-4cd9-b157-4c1085b163e8 tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:02 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.info Sep 05 05:10:02 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:02 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede" returned: 0 in 0.383s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a597ca-2c9a-4309-baef-7aa0a333eb71]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:02 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6f9f355f-44bb-4cd9-b157-4c1085b163e8 tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.info" returned: 0 in 0.299s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6f9f355f-44bb-4cd9-b157-4c1085b163e8 tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.321s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.801s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-204654038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9472aa39-841e-4732-a0b9-fcd6b4056aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e060f41985ef42ed984fef4a33a9e70c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:02Z,use_quota=True,user_id='e3aeed1643d546498fe1a9337084f28b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Creating volume 9472aa39-841e-4732-a0b9-fcd6b4056aad {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:10:02 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9472aa39-841e-4732-a0b9-fcd6b4056aad 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:02 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a Sep 05 05:10:02 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:02 devstack sudo[98994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9472aa39-841e-4732-a0b9-fcd6b4056aad 1073741824 Sep 05 05:10:02 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:02 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-6f9f355f-44bb-4cd9-b157-4c1085b163e8 tempest-VolumesSnapshotListTestJSON-728014487 None] Create snapshot completed successfully Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Flow 'volume_create_manager' (fce32ca1-f449-4ad8-ba53-1f5bb6b64e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef30034-6ec2-4a76-af50-a2720eca42b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef30034-6ec2-4a76-af50-a2720eca42b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1045590321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf0a2df-5cbe-4311-b6dd-79395ed36544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17cf188567f6467897845de7003998b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:03Z,use_quota=True,user_id='7b360e271db14f40be1957f2ac276bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e2d46c-6110-406c-9263-d7dc21272e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e2d46c-6110-406c-9263-d7dc21272e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ae609e-4288-4fb6-9c39-152fef564039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ae609e-4288-4fb6-9c39-152fef564039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cf0a2df-5cbe-4311-b6dd-79395ed36544', 'volume_name': 'volume-3cf0a2df-5cbe-4311-b6dd-79395ed36544', 'volume_size': 2}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2e9e7d-06a8-4805-b3ee-84625bcb28f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2e9e7d-06a8-4805-b3ee-84625bcb28f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b9b0452-8705-4866-82ec-4348db92ebc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:02 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Volume 3cf0a2df-5cbe-4311-b6dd-79395ed36544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cf0a2df-5cbe-4311-b6dd-79395ed36544', 'volume_size': 2} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:02 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a" returned: 0 in 0.416s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36d36857-69b0-4665-a907-fe6a5c844ede(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7995c899-8678-4a5b-b586-3ca2f59fb9bd]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-66a8b7c6-26ee-4052-9a25-f179906d872d tempest-VolumesSnapshotListTestJSON-728014487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:02 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0 Sep 05 05:10:02 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:03 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9472aa39-841e-4732-a0b9-fcd6b4056aad 1073741824" returned: 0 in 0.504s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9472aa39-841e-4732-a0b9-fcd6b4056aad {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:03 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9472aa39-841e-4732-a0b9-fcd6b4056aad Sep 05 05:10:03 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:03 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0" returned: 0 in 0.398s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36d36857-69b0-4665-a907-fe6a5c844ede(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[06489a45-eae6-4e9b-ae44-5ae8e7fbbb86]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:03 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9472aa39-841e-4732-a0b9-fcd6b4056aad" returned: 0 in 0.245s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.597s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1045590321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf0a2df-5cbe-4311-b6dd-79395ed36544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17cf188567f6467897845de7003998b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:03Z,use_quota=True,user_id='7b360e271db14f40be1957f2ac276bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Creating volume 3cf0a2df-5cbe-4311-b6dd-79395ed36544 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:10:03 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3cf0a2df-5cbe-4311-b6dd-79395ed36544 2147483648 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaec5bd8-c53e-4012-b511-618171c7d993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9472aa39-841e-4732-a0b9-fcd6b4056aad', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:03 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3cf0a2df-5cbe-4311-b6dd-79395ed36544 2147483648 Sep 05 05:10:03 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:03 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede Sep 05 05:10:03 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4cc2ab-322e-444a-9246-518465ecffd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:03 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Volume volume-9472aa39-841e-4732-a0b9-fcd6b4056aad (9472aa39-841e-4732-a0b9-fcd6b4056aad): created successfully Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4cc2ab-322e-444a-9246-518465ecffd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Flow 'volume_create_manager' (720fbcc6-8aac-4195-b332-c2fd5d8bcb32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:03 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-eb21262b-71bd-448a-8b99-b5a56c564754 tempest-AbsoluteLimitsTests-1985872545 None] Created volume successfully. Sep 05 05:10:03 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede" returned: 0 in 0.374s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:03 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0 Sep 05 05:10:03 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:03 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3cf0a2df-5cbe-4311-b6dd-79395ed36544 2147483648" returned: 0 in 0.530s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3cf0a2df-5cbe-4311-b6dd-79395ed36544 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:03 devstack sudo[99027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3cf0a2df-5cbe-4311-b6dd-79395ed36544 Sep 05 05:10:03 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-64f19737-c612-40f9-84e7-a588682ae19d tempest-AbsoluteLimitsTests-1985872545 None] Acquiring lock "cinder-9472aa39-841e-4732-a0b9-fcd6b4056aad-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-64f19737-c612-40f9-84e7-a588682ae19d tempest-AbsoluteLimitsTests-1985872545 None] Lock "cinder-9472aa39-841e-4732-a0b9-fcd6b4056aad-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-64f19737-c612-40f9-84e7-a588682ae19d tempest-AbsoluteLimitsTests-1985872545 None] Acquiring lock "cinder-quobyte-9472aa39-841e-4732-a0b9-fcd6b4056aad" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-64f19737-c612-40f9-84e7-a588682ae19d tempest-AbsoluteLimitsTests-1985872545 None] Lock "cinder-quobyte-9472aa39-841e-4732-a0b9-fcd6b4056aad" acquired by "delete_volume" :: waited 0.019s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:04 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0" returned: 0 in 0.458s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07c4e16-23f8-4463-aa5e-b493a6d9e70c]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-64f19737-c612-40f9-84e7-a588682ae19d tempest-AbsoluteLimitsTests-1985872545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9472aa39-841e-4732-a0b9-fcd6b4056aad {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:04 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0 Sep 05 05:10:04 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:04 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3cf0a2df-5cbe-4311-b6dd-79395ed36544" returned: 0 in 0.297s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-66a8b7c6-26ee-4052-9a25-f179906d872d tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.250s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-66a8b7c6-26ee-4052-9a25-f179906d872d tempest-VolumesSnapshotListTestJSON-728014487 None] Creating offline snapshot b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 of volume 944cace7-43c4-4f25-ba6e-3e23c5192db8 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:10:04 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9472aa39-841e-4732-a0b9-fcd6b4056aad Sep 05 05:10:04 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b9b0452-8705-4866-82ec-4348db92ebc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cf0a2df-5cbe-4311-b6dd-79395ed36544', 'volume_size': 2}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a50eecc4-e605-4bd4-87fd-52a4837b763a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9331a50b-d162-4b53-a086-6a9e212b800f]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-66a8b7c6-26ee-4052-9a25-f179906d872d tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:04 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Volume volume-3cf0a2df-5cbe-4311-b6dd-79395ed36544 (3cf0a2df-5cbe-4311-b6dd-79395ed36544): created successfully Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a50eecc4-e605-4bd4-87fd-52a4837b763a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Flow 'volume_create_manager' (fce32ca1-f449-4ad8-ba53-1f5bb6b64e26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:04 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-56d80f43-b987-4c6c-bb61-15b78c8a0b13 tempest-VolumesCloneNegativeTest-1008927909 None] Created volume successfully. Sep 05 05:10:04 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.a54eff9c-106f-4790-bc09-e4660d6e51f0" returned: 0 in 0.294s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36d36857-69b0-4665-a907-fe6a5c844ede /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a -F qcow2 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:04 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402 Sep 05 05:10:04 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:04 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36d36857-69b0-4665-a907-fe6a5c844ede /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a -F qcow2 Sep 05 05:10:04 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:04 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-64f19737-c612-40f9-84e7-a588682ae19d tempest-AbsoluteLimitsTests-1985872545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9472aa39-841e-4732-a0b9-fcd6b4056aad" returned: 0 in 0.389s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-64f19737-c612-40f9-84e7-a588682ae19d tempest-AbsoluteLimitsTests-1985872545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9472aa39-841e-4732-a0b9-fcd6b4056aad {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:04 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9472aa39-841e-4732-a0b9-fcd6b4056aad Sep 05 05:10:04 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:04 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-66a8b7c6-26ee-4052-9a25-f179906d872d tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402" returned: 0 in 0.394s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-66a8b7c6-26ee-4052-9a25-f179906d872d tempest-VolumesSnapshotListTestJSON-728014487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-944cace7-43c4-4f25-ba6e-3e23c5192db8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-66a8b7c6-26ee-4052-9a25-f179906d872d tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:04 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36d36857-69b0-4665-a907-fe6a5c844ede /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a -F qcow2" returned: 0 in 0.324s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:04 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 1G Sep 05 05:10:04 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-quobyte-a54eff9c-106f-4790-bc09-e4660d6e51f0" released by "_delete_snapshot" :: held 3.259s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-quobyte-36d36857-69b0-4665-a907-fe6a5c844ede" released by "delete_snapshot" :: held 3.290s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:04 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Created reservations ['22e5ff60-4b25-4718-949e-bf531a26269d', 'c365339b-a92a-4cb2-a07b-35f58e50dee8', 'e8ccae60-8281-40b8-9c9c-c7c8d1cb5394', 'c0d61354-f905-4c48-883a-17d377e76691'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-64f19737-c612-40f9-84e7-a588682ae19d tempest-AbsoluteLimitsTests-1985872545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9472aa39-841e-4732-a0b9-fcd6b4056aad" returned: 0 in 0.327s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-64f19737-c612-40f9-84e7-a588682ae19d tempest-AbsoluteLimitsTests-1985872545 None] Lock "cinder-quobyte-9472aa39-841e-4732-a0b9-fcd6b4056aad" released by "delete_volume" :: held 0.770s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:04 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Delete snapshot completed successfully. Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-921beb6e-4c2e-4637-9733-87beb8f18088 tempest-VolumesCloneNegativeTest-1008927909 None] Acquiring lock "cinder-3cf0a2df-5cbe-4311-b6dd-79395ed36544-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-a54eff9c-106f-4790-bc09-e4660d6e51f0-delete_snapshot" released by "delete_snapshot" :: held 3.500s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "cinder-f2843aa7-58db-4f94-955e-2952a6cae58a-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-64f19737-c612-40f9-84e7-a588682ae19d tempest-AbsoluteLimitsTests-1985872545 None] Created reservations ['5b5e8a66-24e9-4e0f-b933-6d1a5a864593', '27ce0deb-e559-41d3-897e-d27c9c6096dc', 'b704573d-63c1-41b0-8624-cdd745343ec6', 'b480d9b1-44eb-4fd1-8f00-77496f0cc5e7'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-921beb6e-4c2e-4637-9733-87beb8f18088 tempest-VolumesCloneNegativeTest-1008927909 None] Lock "cinder-3cf0a2df-5cbe-4311-b6dd-79395ed36544-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-f2843aa7-58db-4f94-955e-2952a6cae58a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "cinder-quobyte-36d36857-69b0-4665-a907-fe6a5c844ede" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-921beb6e-4c2e-4637-9733-87beb8f18088 tempest-VolumesCloneNegativeTest-1008927909 None] Acquiring lock "cinder-quobyte-3cf0a2df-5cbe-4311-b6dd-79395ed36544" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-quobyte-36d36857-69b0-4665-a907-fe6a5c844ede" acquired by "delete_snapshot" :: waited 0.042s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "cinder-quobyte-f2843aa7-58db-4f94-955e-2952a6cae58a" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-921beb6e-4c2e-4637-9733-87beb8f18088 tempest-VolumesCloneNegativeTest-1008927909 None] Lock "cinder-quobyte-3cf0a2df-5cbe-4311-b6dd-79395ed36544" acquired by "delete_volume" :: waited 0.043s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-quobyte-f2843aa7-58db-4f94-955e-2952a6cae58a" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Deleting offline snapshot f2843aa7-58db-4f94-955e-2952a6cae58a of volume 36d36857-69b0-4665-a907-fe6a5c844ede {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] snapshot_file for this snap is: volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[207177fa-4a83-462c-b9a4-96b797ef3298]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-921beb6e-4c2e-4637-9733-87beb8f18088 tempest-VolumesCloneNegativeTest-1008927909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3cf0a2df-5cbe-4311-b6dd-79395ed36544 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[15aa077a-aae1-4115-8935-1063e99ca340]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-64f19737-c612-40f9-84e7-a588682ae19d tempest-AbsoluteLimitsTests-1985872545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-64f19737-c612-40f9-84e7-a588682ae19d tempest-AbsoluteLimitsTests-1985872545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-64f19737-c612-40f9-84e7-a588682ae19d tempest-AbsoluteLimitsTests-1985872545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-64f19737-c612-40f9-84e7-a588682ae19d tempest-AbsoluteLimitsTests-1985872545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-64f19737-c612-40f9-84e7-a588682ae19d tempest-AbsoluteLimitsTests-1985872545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-64f19737-c612-40f9-84e7-a588682ae19d tempest-AbsoluteLimitsTests-1985872545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:05 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:10:05 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:05 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3cf0a2df-5cbe-4311-b6dd-79395ed36544 Sep 05 05:10:05 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:05 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-66a8b7c6-26ee-4052-9a25-f179906d872d tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 1G" returned: 0 in 0.589s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-66a8b7c6-26ee-4052-9a25-f179906d872d tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:05 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a Sep 05 05:10:05 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:05 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 Sep 05 05:10:05 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:05 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-64f19737-c612-40f9-84e7-a588682ae19d tempest-AbsoluteLimitsTests-1985872545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.382s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-64f19737-c612-40f9-84e7-a588682ae19d tempest-AbsoluteLimitsTests-1985872545 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:10:05 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-64f19737-c612-40f9-84e7-a588682ae19d tempest-AbsoluteLimitsTests-1985872545 None] Deleted volume successfully. Sep 05 05:10:05 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-921beb6e-4c2e-4637-9733-87beb8f18088 tempest-VolumesCloneNegativeTest-1008927909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3cf0a2df-5cbe-4311-b6dd-79395ed36544" returned: 0 in 0.509s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-921beb6e-4c2e-4637-9733-87beb8f18088 tempest-VolumesCloneNegativeTest-1008927909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3cf0a2df-5cbe-4311-b6dd-79395ed36544 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:05 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-64f19737-c612-40f9-84e7-a588682ae19d tempest-AbsoluteLimitsTests-1985872545 None] Lock "cinder-9472aa39-841e-4732-a0b9-fcd6b4056aad-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a" returned: 0 in 0.507s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36d36857-69b0-4665-a907-fe6a5c844ede(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:10:05 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3cf0a2df-5cbe-4311-b6dd-79395ed36544 Sep 05 05:10:05 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f42ccd2-54f5-4c53-b447-d0953234cabf]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:05 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-66a8b7c6-26ee-4052-9a25-f179906d872d tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1" returned: 0 in 0.438s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:05 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-66a8b7c6-26ee-4052-9a25-f179906d872d tempest-VolumesSnapshotListTestJSON-728014487 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 is being set with open permissions: ugo+rw Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-66a8b7c6-26ee-4052-9a25-f179906d872d tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:05 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 Sep 05 05:10:05 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:05 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede Sep 05 05:10:05 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:05 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-921beb6e-4c2e-4637-9733-87beb8f18088 tempest-VolumesCloneNegativeTest-1008927909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3cf0a2df-5cbe-4311-b6dd-79395ed36544" returned: 0 in 0.286s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-921beb6e-4c2e-4637-9733-87beb8f18088 tempest-VolumesCloneNegativeTest-1008927909 None] Lock "cinder-quobyte-3cf0a2df-5cbe-4311-b6dd-79395ed36544" released by "delete_volume" :: held 0.855s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-921beb6e-4c2e-4637-9733-87beb8f18088 tempest-VolumesCloneNegativeTest-1008927909 None] Created reservations ['29a88aec-f537-469e-b0d7-65d50f29ab35', 'ac41258c-6821-4929-bc6a-c8fb510a24e8', '76830501-b2da-49ea-a3d4-e3c149b9f40c', '28879231-9924-4fa3-8663-e9d014c59e9e'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:10:05 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-66a8b7c6-26ee-4052-9a25-f179906d872d tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1" returned: 0 in 0.277s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-66a8b7c6-26ee-4052-9a25-f179906d872d tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.844s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:06 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-66a8b7c6-26ee-4052-9a25-f179906d872d tempest-VolumesSnapshotListTestJSON-728014487 None] Create snapshot completed successfully Sep 05 05:10:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-921beb6e-4c2e-4637-9733-87beb8f18088 tempest-VolumesCloneNegativeTest-1008927909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-921beb6e-4c2e-4637-9733-87beb8f18088 tempest-VolumesCloneNegativeTest-1008927909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-921beb6e-4c2e-4637-9733-87beb8f18088 tempest-VolumesCloneNegativeTest-1008927909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-921beb6e-4c2e-4637-9733-87beb8f18088 tempest-VolumesCloneNegativeTest-1008927909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-921beb6e-4c2e-4637-9733-87beb8f18088 tempest-VolumesCloneNegativeTest-1008927909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-921beb6e-4c2e-4637-9733-87beb8f18088 tempest-VolumesCloneNegativeTest-1008927909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:06 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede" returned: 0 in 0.476s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:06 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:10:06 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:06 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a Sep 05 05:10:06 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:06 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-921beb6e-4c2e-4637-9733-87beb8f18088 tempest-VolumesCloneNegativeTest-1008927909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.271s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:06 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-921beb6e-4c2e-4637-9733-87beb8f18088 tempest-VolumesCloneNegativeTest-1008927909 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:10:06 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-921beb6e-4c2e-4637-9733-87beb8f18088 tempest-VolumesCloneNegativeTest-1008927909 None] Deleted volume successfully. Sep 05 05:10:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-921beb6e-4c2e-4637-9733-87beb8f18088 tempest-VolumesCloneNegativeTest-1008927909 None] Lock "cinder-3cf0a2df-5cbe-4311-b6dd-79395ed36544-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:06 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a" returned: 0 in 0.410s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:06 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a Sep 05 05:10:06 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:06 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede.f2843aa7-58db-4f94-955e-2952a6cae58a" returned: 0 in 0.302s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-quobyte-f2843aa7-58db-4f94-955e-2952a6cae58a" released by "_delete_snapshot" :: held 1.824s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-quobyte-36d36857-69b0-4665-a907-fe6a5c844ede" released by "delete_snapshot" :: held 1.884s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:06 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Created reservations ['6df08d92-32cd-4cf9-8819-c270c41a0d7e', 'f9325317-9f41-44a9-b601-f8fe2e52f350', '68149d38-12fb-4540-a9ba-a928779773bc', '017d2757-4c97-4d70-9eba-3856b5455e18'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:10:07 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Delete snapshot completed successfully. Sep 05 05:10:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-f2843aa7-58db-4f94-955e-2952a6cae58a-delete_snapshot" released by "delete_snapshot" :: held 2.091s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Snapshots deleted, issuing volume delete {{(pid=89331) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 05 05:10:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "cinder-quobyte-36d36857-69b0-4665-a907-fe6a5c844ede" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-quobyte-36d36857-69b0-4665-a907-fe6a5c844ede" acquired by "delete_volume" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:07 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd86160b-0f60-4090-9533-81b6d4cbc404]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:07 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede Sep 05 05:10:07 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a7443c4a-04be-4773-a89c-57c092da0164 tempest-VolumesSnapshotListTestJSON-728014487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a7443c4a-04be-4773-a89c-57c092da0164 tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-a7443c4a-04be-4773-a89c-57c092da0164 tempest-VolumesSnapshotListTestJSON-728014487 None] Creating offline snapshot eda2bff9-0dc3-4b19-9cac-74e38a271dc2 of volume 944cace7-43c4-4f25-ba6e-3e23c5192db8 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:10:07 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[de77853e-820f-4848-8b3f-bb22a857f648]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a7443c4a-04be-4773-a89c-57c092da0164 tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:07 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede" returned: 0 in 0.443s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:07 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede Sep 05 05:10:07 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:07 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 Sep 05 05:10:07 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:07 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36d36857-69b0-4665-a907-fe6a5c844ede" returned: 0 in 0.290s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-quobyte-36d36857-69b0-4665-a907-fe6a5c844ede" released by "delete_volume" :: held 0.828s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:07 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Created reservations ['726f8d5f-b622-43b2-aff1-6d86511fd220', 'c3d182fc-c689-4f55-a484-f061ae407742', '12934f55-011c-458d-9fb6-027f98b62d6d', 'e6af3194-93b3-4b27-9d24-4f46b8c7e5a4'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:10:08 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a7443c4a-04be-4773-a89c-57c092da0164 tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1" returned: 0 in 0.528s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-a7443c4a-04be-4773-a89c-57c092da0164 tempest-VolumesSnapshotListTestJSON-728014487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-944cace7-43c4-4f25-ba6e-3e23c5192db8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:10:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a7443c4a-04be-4773-a89c-57c092da0164 tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.eda2bff9-0dc3-4b19-9cac-74e38a271dc2 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:08 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.eda2bff9-0dc3-4b19-9cac-74e38a271dc2 1G Sep 05 05:10:08 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:08 devstack sudo[99113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:10:08 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:08 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.263s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:08 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:10:08 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Deleted volume successfully. Sep 05 05:10:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fdd725e-23b8-4249-8746-db6c22097f60 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-36d36857-69b0-4665-a907-fe6a5c844ede-delete_volume" released by "delete_volume" :: held 7.067s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:08 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a7443c4a-04be-4773-a89c-57c092da0164 tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.eda2bff9-0dc3-4b19-9cac-74e38a271dc2 1G" returned: 0 in 0.619s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a7443c4a-04be-4773-a89c-57c092da0164 tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.eda2bff9-0dc3-4b19-9cac-74e38a271dc2 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:08 devstack sudo[99121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.eda2bff9-0dc3-4b19-9cac-74e38a271dc2 Sep 05 05:10:08 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:09 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a7443c4a-04be-4773-a89c-57c092da0164 tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.eda2bff9-0dc3-4b19-9cac-74e38a271dc2" returned: 0 in 0.343s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:09 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-a7443c4a-04be-4773-a89c-57c092da0164 tempest-VolumesSnapshotListTestJSON-728014487 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.eda2bff9-0dc3-4b19-9cac-74e38a271dc2 is being set with open permissions: ugo+rw Sep 05 05:10:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a7443c4a-04be-4773-a89c-57c092da0164 tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.eda2bff9-0dc3-4b19-9cac-74e38a271dc2 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:09 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.eda2bff9-0dc3-4b19-9cac-74e38a271dc2 Sep 05 05:10:09 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:09 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a7443c4a-04be-4773-a89c-57c092da0164 tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.eda2bff9-0dc3-4b19-9cac-74e38a271dc2" returned: 0 in 0.325s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a7443c4a-04be-4773-a89c-57c092da0164 tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.963s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:09 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-a7443c4a-04be-4773-a89c-57c092da0164 tempest-VolumesSnapshotListTestJSON-728014487 None] Create snapshot completed successfully Sep 05 05:10:09 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:10:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Flow 'volume_create_manager' (8d8210d8-3535-43b4-9c53-cf3f05b64cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43cef47d-3482-4388-bc2e-09a4cb4150fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43cef47d-3482-4388-bc2e-09a4cb4150fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1984855379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9000b8c-335a-4471-8c13-14555610cb57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a64772e20e84f0aabec652992234d44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:10Z,use_quota=True,user_id='c9f2beabdc6c42dea8626bc8471a58d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ff1eb9-9cc1-4b74-aff5-b3f0296d8634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ff1eb9-9cc1-4b74-aff5-b3f0296d8634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184bcf8f-c302-4ecc-983e-67c5409220d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184bcf8f-c302-4ecc-983e-67c5409220d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9000b8c-335a-4471-8c13-14555610cb57', 'volume_name': 'volume-f9000b8c-335a-4471-8c13-14555610cb57', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378605e8-5197-421b-9f3c-1a6286f0bb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378605e8-5197-421b-9f3c-1a6286f0bb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c8c99a-4c1b-498e-aaac-a3a470786c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:10 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Volume f9000b8c-335a-4471-8c13-14555610cb57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9000b8c-335a-4471-8c13-14555610cb57', 'volume_size': 1} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1984855379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9000b8c-335a-4471-8c13-14555610cb57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a64772e20e84f0aabec652992234d44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:10Z,use_quota=True,user_id='c9f2beabdc6c42dea8626bc8471a58d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Creating volume f9000b8c-335a-4471-8c13-14555610cb57 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:10:10 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:10 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57 1073741824 Sep 05 05:10:10 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:10 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57 1073741824" returned: 0 in 0.553s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:10 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57 Sep 05 05:10:10 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9eb8b299-c82d-4b8a-a160-806e3d5fb6d1 tempest-VolumesSnapshotListTestJSON-728014487 None] Acquiring lock "cinder-eda2bff9-0dc3-4b19-9cac-74e38a271dc2-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9eb8b299-c82d-4b8a-a160-806e3d5fb6d1 tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "cinder-eda2bff9-0dc3-4b19-9cac-74e38a271dc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9eb8b299-c82d-4b8a-a160-806e3d5fb6d1 tempest-VolumesSnapshotListTestJSON-728014487 None] Acquiring lock "cinder-quobyte-944cace7-43c4-4f25-ba6e-3e23c5192db8" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9eb8b299-c82d-4b8a-a160-806e3d5fb6d1 tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "cinder-quobyte-944cace7-43c4-4f25-ba6e-3e23c5192db8" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9eb8b299-c82d-4b8a-a160-806e3d5fb6d1 tempest-VolumesSnapshotListTestJSON-728014487 None] Acquiring lock "cinder-quobyte-eda2bff9-0dc3-4b19-9cac-74e38a271dc2" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9eb8b299-c82d-4b8a-a160-806e3d5fb6d1 tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "cinder-quobyte-eda2bff9-0dc3-4b19-9cac-74e38a271dc2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-9eb8b299-c82d-4b8a-a160-806e3d5fb6d1 tempest-VolumesSnapshotListTestJSON-728014487 None] Deleting offline snapshot eda2bff9-0dc3-4b19-9cac-74e38a271dc2 of volume 944cace7-43c4-4f25-ba6e-3e23c5192db8 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-9eb8b299-c82d-4b8a-a160-806e3d5fb6d1 tempest-VolumesSnapshotListTestJSON-728014487 None] snapshot_file for this snap is: volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.eda2bff9-0dc3-4b19-9cac-74e38a271dc2 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab68132-712a-44b9-9c09-301b003c0be1]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9eb8b299-c82d-4b8a-a160-806e3d5fb6d1 tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.eda2bff9-0dc3-4b19-9cac-74e38a271dc2 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:11 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.eda2bff9-0dc3-4b19-9cac-74e38a271dc2 Sep 05 05:10:11 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:11 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57" returned: 0 in 0.381s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c8c99a-4c1b-498e-aaac-a3a470786c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9000b8c-335a-4471-8c13-14555610cb57', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76fac8d8-80da-438b-bc90-f643d3099939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:11 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Volume volume-f9000b8c-335a-4471-8c13-14555610cb57 (f9000b8c-335a-4471-8c13-14555610cb57): created successfully Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76fac8d8-80da-438b-bc90-f643d3099939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Flow 'volume_create_manager' (8d8210d8-3535-43b4-9c53-cf3f05b64cbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:11 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-b60623f7-6acb-44e6-8cb6-fc6ef95fa544 tempest-VolumesDeleteCascade-1299616072 None] Created volume successfully. Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Flow 'volume_create_manager' (45bbb7b8-678f-4511-b788-9634cd260efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58ac592-1916-4c4c-9fc1-3e112a98d759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58ac592-1916-4c4c-9fc1-3e112a98d759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-595763229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caac8115-7f2e-4891-b6c4-9b0c7cf8378f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66857b4f0ff747be85c696c8d65d05bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:11Z,use_quota=True,user_id='c05b5434cb874d948e01833602850dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a758411-b093-4643-9168-87cf9c109d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a758411-b093-4643-9168-87cf9c109d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:11 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856c0dd9-4d68-42a8-9f2b-d2eae4af324c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856c0dd9-4d68-42a8-9f2b-d2eae4af324c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caac8115-7f2e-4891-b6c4-9b0c7cf8378f', 'volume_name': 'volume-caac8115-7f2e-4891-b6c4-9b0c7cf8378f', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c856e1-0d97-457d-94ec-3ae5f339b006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c856e1-0d97-457d-94ec-3ae5f339b006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3bc802c-b700-4cc8-ba00-78cbd98df079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:11 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Volume caac8115-7f2e-4891-b6c4-9b0c7cf8378f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caac8115-7f2e-4891-b6c4-9b0c7cf8378f', 'volume_size': 1} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-595763229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caac8115-7f2e-4891-b6c4-9b0c7cf8378f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66857b4f0ff747be85c696c8d65d05bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:11Z,use_quota=True,user_id='c05b5434cb874d948e01833602850dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Creating volume caac8115-7f2e-4891-b6c4-9b0c7cf8378f {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:10:11 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-caac8115-7f2e-4891-b6c4-9b0c7cf8378f 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9eb8b299-c82d-4b8a-a160-806e3d5fb6d1 tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.eda2bff9-0dc3-4b19-9cac-74e38a271dc2" returned: 0 in 0.526s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-9eb8b299-c82d-4b8a-a160-806e3d5fb6d1 tempest-VolumesSnapshotListTestJSON-728014487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-944cace7-43c4-4f25-ba6e-3e23c5192db8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:10:11 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-caac8115-7f2e-4891-b6c4-9b0c7cf8378f 1073741824 Sep 05 05:10:11 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0eeee14-80e3-4836-b2e6-56023c07cb82]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9eb8b299-c82d-4b8a-a160-806e3d5fb6d1 tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:11 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 Sep 05 05:10:11 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:11 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9eb8b299-c82d-4b8a-a160-806e3d5fb6d1 tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1" returned: 0 in 0.394s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-9eb8b299-c82d-4b8a-a160-806e3d5fb6d1 tempest-VolumesSnapshotListTestJSON-728014487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-944cace7-43c4-4f25-ba6e-3e23c5192db8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9eb8b299-c82d-4b8a-a160-806e3d5fb6d1 tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.eda2bff9-0dc3-4b19-9cac-74e38a271dc2 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:11 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.eda2bff9-0dc3-4b19-9cac-74e38a271dc2 Sep 05 05:10:11 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:11 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-caac8115-7f2e-4891-b6c4-9b0c7cf8378f 1073741824" returned: 0 in 0.481s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-caac8115-7f2e-4891-b6c4-9b0c7cf8378f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:11 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-caac8115-7f2e-4891-b6c4-9b0c7cf8378f Sep 05 05:10:11 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3430e7d8-d64f-48b8-9646-8aec9e1b98c6 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:12 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:12 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-caac8115-7f2e-4891-b6c4-9b0c7cf8378f" returned: 0 in 0.377s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3430e7d8-d64f-48b8-9646-8aec9e1b98c6 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.088s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9eb8b299-c82d-4b8a-a160-806e3d5fb6d1 tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.eda2bff9-0dc3-4b19-9cac-74e38a271dc2" returned: 0 in 0.484s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9eb8b299-c82d-4b8a-a160-806e3d5fb6d1 tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.eda2bff9-0dc3-4b19-9cac-74e38a271dc2 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-3430e7d8-d64f-48b8-9646-8aec9e1b98c6 tempest-VolumesDeleteCascade-1299616072 None] Creating offline snapshot 71b683c5-7aaa-48c9-bfdd-55076a39d0c3 of volume f9000b8c-335a-4471-8c13-14555610cb57 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:10:12 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.eda2bff9-0dc3-4b19-9cac-74e38a271dc2 Sep 05 05:10:12 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3bc802c-b700-4cc8-ba00-78cbd98df079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caac8115-7f2e-4891-b6c4-9b0c7cf8378f', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90af9801-5774-45fa-b0b5-cd28d50b3d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb72aba3-ac28-4b89-9c82-e405aa310386]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3430e7d8-d64f-48b8-9646-8aec9e1b98c6 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:12 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Volume volume-caac8115-7f2e-4891-b6c4-9b0c7cf8378f (caac8115-7f2e-4891-b6c4-9b0c7cf8378f): created successfully Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90af9801-5774-45fa-b0b5-cd28d50b3d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Flow 'volume_create_manager' (45bbb7b8-678f-4511-b788-9634cd260efd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:12 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-93a10c0f-a918-45ac-b828-cb94f61b0689 tempest-VolumesNegativeTest-346893649 None] Created volume successfully. Sep 05 05:10:12 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57 Sep 05 05:10:12 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:12 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9eb8b299-c82d-4b8a-a160-806e3d5fb6d1 tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.eda2bff9-0dc3-4b19-9cac-74e38a271dc2" returned: 0 in 0.295s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9eb8b299-c82d-4b8a-a160-806e3d5fb6d1 tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "cinder-quobyte-eda2bff9-0dc3-4b19-9cac-74e38a271dc2" released by "_delete_snapshot" :: held 1.823s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9eb8b299-c82d-4b8a-a160-806e3d5fb6d1 tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "cinder-quobyte-944cace7-43c4-4f25-ba6e-3e23c5192db8" released by "delete_snapshot" :: held 1.859s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-9eb8b299-c82d-4b8a-a160-806e3d5fb6d1 tempest-VolumesSnapshotListTestJSON-728014487 None] Created reservations ['4d0b1422-caea-4ed5-82ba-0fca456614ce', 'bafc37ff-645b-4425-912e-37ab567dc6e8', '865bdf83-fc6a-47e5-a6cd-2e6b8fb8ae55', '85e43241-cc2d-466b-bb8d-293cf3a6da65'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:10:12 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3430e7d8-d64f-48b8-9646-8aec9e1b98c6 tempest-VolumesDeleteCascade-1299616072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57" returned: 0 in 0.437s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3430e7d8-d64f-48b8-9646-8aec9e1b98c6 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.71b683c5-7aaa-48c9-bfdd-55076a39d0c3 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:12 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-9eb8b299-c82d-4b8a-a160-806e3d5fb6d1 tempest-VolumesSnapshotListTestJSON-728014487 None] Delete snapshot completed successfully. Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9eb8b299-c82d-4b8a-a160-806e3d5fb6d1 tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "cinder-eda2bff9-0dc3-4b19-9cac-74e38a271dc2-delete_snapshot" released by "delete_snapshot" :: held 2.050s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:12 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.71b683c5-7aaa-48c9-bfdd-55076a39d0c3 1G Sep 05 05:10:12 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2589a139-a9f9-4c49-ba02-f5465c39c889 tempest-VolumesSnapshotListTestJSON-728014487 None] Acquiring lock "cinder-b9bdb2a7-4a06-4850-a4b1-5c017009ccc1-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2589a139-a9f9-4c49-ba02-f5465c39c889 tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "cinder-b9bdb2a7-4a06-4850-a4b1-5c017009ccc1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2589a139-a9f9-4c49-ba02-f5465c39c889 tempest-VolumesSnapshotListTestJSON-728014487 None] Acquiring lock "cinder-quobyte-944cace7-43c4-4f25-ba6e-3e23c5192db8" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2589a139-a9f9-4c49-ba02-f5465c39c889 tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "cinder-quobyte-944cace7-43c4-4f25-ba6e-3e23c5192db8" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2589a139-a9f9-4c49-ba02-f5465c39c889 tempest-VolumesSnapshotListTestJSON-728014487 None] Acquiring lock "cinder-quobyte-b9bdb2a7-4a06-4850-a4b1-5c017009ccc1" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2589a139-a9f9-4c49-ba02-f5465c39c889 tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "cinder-quobyte-b9bdb2a7-4a06-4850-a4b1-5c017009ccc1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-2589a139-a9f9-4c49-ba02-f5465c39c889 tempest-VolumesSnapshotListTestJSON-728014487 None] Deleting offline snapshot b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 of volume 944cace7-43c4-4f25-ba6e-3e23c5192db8 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-2589a139-a9f9-4c49-ba02-f5465c39c889 tempest-VolumesSnapshotListTestJSON-728014487 None] snapshot_file for this snap is: volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[740b6291-aa06-4ad2-a029-52acf23c7b74]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2589a139-a9f9-4c49-ba02-f5465c39c889 tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:13 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 Sep 05 05:10:13 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:13 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3430e7d8-d64f-48b8-9646-8aec9e1b98c6 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.71b683c5-7aaa-48c9-bfdd-55076a39d0c3 1G" returned: 0 in 0.486s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3430e7d8-d64f-48b8-9646-8aec9e1b98c6 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9000b8c-335a-4471-8c13-14555610cb57 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.71b683c5-7aaa-48c9-bfdd-55076a39d0c3 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:13 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9000b8c-335a-4471-8c13-14555610cb57 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.71b683c5-7aaa-48c9-bfdd-55076a39d0c3 Sep 05 05:10:13 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2589a139-a9f9-4c49-ba02-f5465c39c889 tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1" returned: 0 in 0.466s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-2589a139-a9f9-4c49-ba02-f5465c39c889 tempest-VolumesSnapshotListTestJSON-728014487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-944cace7-43c4-4f25-ba6e-3e23c5192db8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:10:13 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4abc332-279e-4d91-a67b-77978c0c6cab]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2589a139-a9f9-4c49-ba02-f5465c39c889 tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Flow 'volume_create_manager' (2b8ab412-eb76-4f2d-bcaa-75351d57e13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12dec6e-2df3-4652-9bcc-93749dbc28ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12dec6e-2df3-4652-9bcc-93749dbc28ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2134165579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18271bd2-6669-4f96-a756-029793e795bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82af3a6e535c4cef91746d6e1fddc1c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:14Z,use_quota=True,user_id='55ec7cb734e7403c988b5df953a57bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:13 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402 Sep 05 05:10:13 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d987b1-7ab2-40a1-8757-eca9c67e468d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d987b1-7ab2-40a1-8757-eca9c67e468d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a4dfb7-0f21-46e7-943b-f74da0f455f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a4dfb7-0f21-46e7-943b-f74da0f455f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18271bd2-6669-4f96-a756-029793e795bc', 'volume_name': 'volume-18271bd2-6669-4f96-a756-029793e795bc', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54216e0a-9af3-4aa3-995e-0ab71de36cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:13 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54216e0a-9af3-4aa3-995e-0ab71de36cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9880d299-283f-4f65-81c0-a8b4b432ec71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:13 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Volume 18271bd2-6669-4f96-a756-029793e795bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18271bd2-6669-4f96-a756-029793e795bc', 'volume_size': 1} Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3430e7d8-d64f-48b8-9646-8aec9e1b98c6 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9000b8c-335a-4471-8c13-14555610cb57 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.71b683c5-7aaa-48c9-bfdd-55076a39d0c3" returned: 0 in 0.424s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:13 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-3430e7d8-d64f-48b8-9646-8aec9e1b98c6 tempest-VolumesDeleteCascade-1299616072 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.71b683c5-7aaa-48c9-bfdd-55076a39d0c3 is being set with open permissions: ugo+rw Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3430e7d8-d64f-48b8-9646-8aec9e1b98c6 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.71b683c5-7aaa-48c9-bfdd-55076a39d0c3 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:13 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.71b683c5-7aaa-48c9-bfdd-55076a39d0c3 Sep 05 05:10:13 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:13 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2589a139-a9f9-4c49-ba02-f5465c39c889 tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402" returned: 0 in 0.423s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-2589a139-a9f9-4c49-ba02-f5465c39c889 tempest-VolumesSnapshotListTestJSON-728014487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-944cace7-43c4-4f25-ba6e-3e23c5192db8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2589a139-a9f9-4c49-ba02-f5465c39c889 tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:13 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3430e7d8-d64f-48b8-9646-8aec9e1b98c6 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.71b683c5-7aaa-48c9-bfdd-55076a39d0c3" returned: 0 in 0.263s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:13 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 Sep 05 05:10:13 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3430e7d8-d64f-48b8-9646-8aec9e1b98c6 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:14 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.info Sep 05 05:10:14 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:14 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3430e7d8-d64f-48b8-9646-8aec9e1b98c6 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.info" returned: 0 in 0.321s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:14 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-3430e7d8-d64f-48b8-9646-8aec9e1b98c6 tempest-VolumesDeleteCascade-1299616072 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.info is being set with open permissions: ugo+rw Sep 05 05:10:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3430e7d8-d64f-48b8-9646-8aec9e1b98c6 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:14 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.info Sep 05 05:10:14 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:14 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2589a139-a9f9-4c49-ba02-f5465c39c889 tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1" returned: 0 in 0.489s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2589a139-a9f9-4c49-ba02-f5465c39c889 tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:14 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1 Sep 05 05:10:14 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:14 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3430e7d8-d64f-48b8-9646-8aec9e1b98c6 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.info" returned: 0 in 0.280s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3430e7d8-d64f-48b8-9646-8aec9e1b98c6 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.332s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.933s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:14 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2134165579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18271bd2-6669-4f96-a756-029793e795bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82af3a6e535c4cef91746d6e1fddc1c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:14Z,use_quota=True,user_id='55ec7cb734e7403c988b5df953a57bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:10:14 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Creating volume 18271bd2-6669-4f96-a756-029793e795bc {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:10:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:14 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:14 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:14 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:10:14 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:10:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-18271bd2-6669-4f96-a756-029793e795bc 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:14 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-18271bd2-6669-4f96-a756-029793e795bc 1073741824 Sep 05 05:10:14 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:14 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-3430e7d8-d64f-48b8-9646-8aec9e1b98c6 tempest-VolumesDeleteCascade-1299616072 None] Create snapshot completed successfully Sep 05 05:10:14 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2589a139-a9f9-4c49-ba02-f5465c39c889 tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.b9bdb2a7-4a06-4850-a4b1-5c017009ccc1" returned: 0 in 0.300s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:14 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2589a139-a9f9-4c49-ba02-f5465c39c889 tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "cinder-quobyte-b9bdb2a7-4a06-4850-a4b1-5c017009ccc1" released by "_delete_snapshot" :: held 1.812s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:14 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2589a139-a9f9-4c49-ba02-f5465c39c889 tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "cinder-quobyte-944cace7-43c4-4f25-ba6e-3e23c5192db8" released by "delete_snapshot" :: held 1.837s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:14 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-2589a139-a9f9-4c49-ba02-f5465c39c889 tempest-VolumesSnapshotListTestJSON-728014487 None] Created reservations ['de74ad81-ea6d-411b-b179-87246ac1f7ed', '9294a88e-d10e-4cf3-8e86-76fb21aaab3b', '18bc7a3c-c4db-4f7d-8ca8-487453645aca', '182ffdd6-46a8-4fbd-80ab-0a8dace8cb14'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:10:14 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-2589a139-a9f9-4c49-ba02-f5465c39c889 tempest-VolumesSnapshotListTestJSON-728014487 None] Delete snapshot completed successfully. Sep 05 05:10:14 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2589a139-a9f9-4c49-ba02-f5465c39c889 tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "cinder-b9bdb2a7-4a06-4850-a4b1-5c017009ccc1-delete_snapshot" released by "delete_snapshot" :: held 2.006s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-064e986b-6662-451f-9e7e-3178863aa307 tempest-VolumesSnapshotListTestJSON-728014487 None] Acquiring lock "cinder-9352d2e4-f1df-4514-a57c-045ff2978402-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-064e986b-6662-451f-9e7e-3178863aa307 tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "cinder-9352d2e4-f1df-4514-a57c-045ff2978402-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-064e986b-6662-451f-9e7e-3178863aa307 tempest-VolumesSnapshotListTestJSON-728014487 None] Acquiring lock "cinder-quobyte-944cace7-43c4-4f25-ba6e-3e23c5192db8" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-064e986b-6662-451f-9e7e-3178863aa307 tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "cinder-quobyte-944cace7-43c4-4f25-ba6e-3e23c5192db8" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-064e986b-6662-451f-9e7e-3178863aa307 tempest-VolumesSnapshotListTestJSON-728014487 None] Acquiring lock "cinder-quobyte-9352d2e4-f1df-4514-a57c-045ff2978402" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-064e986b-6662-451f-9e7e-3178863aa307 tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "cinder-quobyte-9352d2e4-f1df-4514-a57c-045ff2978402" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:15 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-064e986b-6662-451f-9e7e-3178863aa307 tempest-VolumesSnapshotListTestJSON-728014487 None] Deleting offline snapshot 9352d2e4-f1df-4514-a57c-045ff2978402 of volume 944cace7-43c4-4f25-ba6e-3e23c5192db8 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:10:15 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-064e986b-6662-451f-9e7e-3178863aa307 tempest-VolumesSnapshotListTestJSON-728014487 None] snapshot_file for this snap is: volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:10:15 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-18271bd2-6669-4f96-a756-029793e795bc 1073741824" returned: 0 in 0.540s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:15 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff2fbd7-6381-4788-b22c-cc9a63d89b18]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-064e986b-6662-451f-9e7e-3178863aa307 tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-18271bd2-6669-4f96-a756-029793e795bc {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:15 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-18271bd2-6669-4f96-a756-029793e795bc Sep 05 05:10:15 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:15 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402 Sep 05 05:10:15 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:15 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-18271bd2-6669-4f96-a756-029793e795bc" returned: 0 in 0.415s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:15 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:10:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:15 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9880d299-283f-4f65-81c0-a8b4b432ec71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18271bd2-6669-4f96-a756-029793e795bc', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:15 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05fa6f0e-5267-4711-b978-c4ec81922d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:15 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Volume volume-18271bd2-6669-4f96-a756-029793e795bc (18271bd2-6669-4f96-a756-029793e795bc): created successfully Sep 05 05:10:15 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05fa6f0e-5267-4711-b978-c4ec81922d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:15 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Flow 'volume_create_manager' (2b8ab412-eb76-4f2d-bcaa-75351d57e13f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:15 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-9b79f14c-8d00-43af-b131-4570723a6700 tempest-VolumesTransfersTest-1457384829 None] Created volume successfully. Sep 05 05:10:15 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-064e986b-6662-451f-9e7e-3178863aa307 tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402" returned: 0 in 0.646s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:15 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-064e986b-6662-451f-9e7e-3178863aa307 tempest-VolumesSnapshotListTestJSON-728014487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-944cace7-43c4-4f25-ba6e-3e23c5192db8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:10:15 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[889f459b-9e77-405a-9bcf-682407fa8fd9]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-064e986b-6662-451f-9e7e-3178863aa307 tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:16 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8 Sep 05 05:10:16 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Flow 'volume_create_manager' (1a7dca35-81b8-4c0c-b6e2-8646cdac5fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c4124b-83d4-40ad-8ae2-5e264e38183d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c4124b-83d4-40ad-8ae2-5e264e38183d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1967842625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a64772e20e84f0aabec652992234d44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=71b683c5-7aaa-48c9-bfdd-55076a39d0c3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:16Z,use_quota=True,user_id='c9f2beabdc6c42dea8626bc8471a58d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9036b43f-a43c-4ddd-8e15-24c6fd7223e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9036b43f-a43c-4ddd-8e15-24c6fd7223e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d656dad9-603d-4eda-9db1-d618344a4e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d656dad9-603d-4eda-9db1-d618344a4e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb', 'volume_name': 'volume-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb', 'volume_size': 1, 'snapshot_id': '71b683c5-7aaa-48c9-bfdd-55076a39d0c3'}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25949bb2-e972-4550-abc4-b82dadabfec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25949bb2-e972-4550-abc4-b82dadabfec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f248608-35fb-4181-8641-12971aab51ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:16 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Volume 25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb', 'volume_size': 1, 'snapshot_id': '71b683c5-7aaa-48c9-bfdd-55076a39d0c3'} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "cinder-quobyte-71b683c5-7aaa-48c9-bfdd-55076a39d0c3-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb" by "_create_volume_from_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-quobyte-71b683c5-7aaa-48c9-bfdd-55076a39d0c3-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Creating volume 25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb from snapshot 71b683c5-7aaa-48c9-bfdd-55076a39d0c3 {{(pid=89331) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 05:10:16 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "cinder-quobyte-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb" by "_copy_volume_from_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-064e986b-6662-451f-9e7e-3178863aa307 tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8" returned: 0 in 0.551s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-064e986b-6662-451f-9e7e-3178863aa307 tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-quobyte-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] snapshot: 71b683c5-7aaa-48c9-bfdd-55076a39d0c3, volume: 25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb, {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 05:10:16 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402 Sep 05 05:10:16 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc4fe75-d82c-4862-9c01-5eac10937cc5]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.71b683c5-7aaa-48c9-bfdd-55076a39d0c3 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:16 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.71b683c5-7aaa-48c9-bfdd-55076a39d0c3 Sep 05 05:10:16 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:16 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-064e986b-6662-451f-9e7e-3178863aa307 tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402" returned: 0 in 0.488s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-064e986b-6662-451f-9e7e-3178863aa307 tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:16 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402 Sep 05 05:10:16 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:17 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.71b683c5-7aaa-48c9-bfdd-55076a39d0c3" returned: 0 in 0.465s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9000b8c-335a-4471-8c13-14555610cb57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:10:17 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd02c9f-59ab-40a0-b936-a6705555a7b5]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:17 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57 Sep 05 05:10:17 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:17 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-064e986b-6662-451f-9e7e-3178863aa307 tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8.9352d2e4-f1df-4514-a57c-045ff2978402" returned: 0 in 0.462s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:17 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-064e986b-6662-451f-9e7e-3178863aa307 tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "cinder-quobyte-9352d2e4-f1df-4514-a57c-045ff2978402" released by "_delete_snapshot" :: held 2.300s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:17 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-064e986b-6662-451f-9e7e-3178863aa307 tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "cinder-quobyte-944cace7-43c4-4f25-ba6e-3e23c5192db8" released by "delete_snapshot" :: held 2.341s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:17 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-064e986b-6662-451f-9e7e-3178863aa307 tempest-VolumesSnapshotListTestJSON-728014487 None] Created reservations ['2601b7c7-54ad-46f4-9b1b-d4a9de36cf19', '86450a2b-3fcb-4802-b672-a8dbfacb4633', '72638151-66b8-45be-8157-cb4fa6f29050', '77713106-ac5c-4944-8b64-190c3bc95534'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:10:17 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57" returned: 0 in 0.534s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57 {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 05:10:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Creating direct copy from snapshot {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 05:10:17 devstack cinder-volume[89331]: DEBUG cinder.utils [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Path /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb not found in is_blk_device check {{(pid=89331) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 05:10:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:17 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb Sep 05 05:10:17 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:17 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-064e986b-6662-451f-9e7e-3178863aa307 tempest-VolumesSnapshotListTestJSON-728014487 None] Delete snapshot completed successfully. Sep 05 05:10:17 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-064e986b-6662-451f-9e7e-3178863aa307 tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "cinder-9352d2e4-f1df-4514-a57c-045ff2978402-delete_snapshot" released by "delete_snapshot" :: held 2.561s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:17 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-5cf0c596-50d3-4896-ba2a-b7c0455eadde tempest-VolumesTransfersTest-445674677 None] Transfer volume completed successfully. Sep 05 05:10:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d1e07b6c-e039-4bf2-aae1-e1b3738c8cbf tempest-VolumesSnapshotListTestJSON-728014487 None] Acquiring lock "cinder-944cace7-43c4-4f25-ba6e-3e23c5192db8-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d1e07b6c-e039-4bf2-aae1-e1b3738c8cbf tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "cinder-944cace7-43c4-4f25-ba6e-3e23c5192db8-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d1e07b6c-e039-4bf2-aae1-e1b3738c8cbf tempest-VolumesSnapshotListTestJSON-728014487 None] Acquiring lock "cinder-quobyte-944cace7-43c4-4f25-ba6e-3e23c5192db8" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:19 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d1e07b6c-e039-4bf2-aae1-e1b3738c8cbf tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "cinder-quobyte-944cace7-43c4-4f25-ba6e-3e23c5192db8" acquired by "delete_volume" :: waited 0.068s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:19 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4773eed-10ac-449d-b064-0c0747a19259]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:19 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-90057787-7d1a-4189-b1ec-9158d4461812 tempest-VolumesTransfersTest-1065980743 None] Acquiring lock "cinder-18271bd2-6669-4f96-a756-029793e795bc-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d1e07b6c-e039-4bf2-aae1-e1b3738c8cbf tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:19 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-90057787-7d1a-4189-b1ec-9158d4461812 tempest-VolumesTransfersTest-1065980743 None] Lock "cinder-18271bd2-6669-4f96-a756-029793e795bc-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:19 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-90057787-7d1a-4189-b1ec-9158d4461812 tempest-VolumesTransfersTest-1065980743 None] Acquiring lock "cinder-quobyte-18271bd2-6669-4f96-a756-029793e795bc" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:19 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-90057787-7d1a-4189-b1ec-9158d4461812 tempest-VolumesTransfersTest-1065980743 None] Lock "cinder-quobyte-18271bd2-6669-4f96-a756-029793e795bc" acquired by "delete_volume" :: waited 0.054s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:19 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8 Sep 05 05:10:19 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:19 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14f3e64-37c2-4907-85f8-e7d16632bacb]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-90057787-7d1a-4189-b1ec-9158d4461812 tempest-VolumesTransfersTest-1065980743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-18271bd2-6669-4f96-a756-029793e795bc {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:19 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-18271bd2-6669-4f96-a756-029793e795bc Sep 05 05:10:19 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:20 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d1e07b6c-e039-4bf2-aae1-e1b3738c8cbf tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8" returned: 0 in 1.271s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d1e07b6c-e039-4bf2-aae1-e1b3738c8cbf tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:20 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8 Sep 05 05:10:20 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:20 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-90057787-7d1a-4189-b1ec-9158d4461812 tempest-VolumesTransfersTest-1065980743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-18271bd2-6669-4f96-a756-029793e795bc" returned: 0 in 1.102s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-90057787-7d1a-4189-b1ec-9158d4461812 tempest-VolumesTransfersTest-1065980743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-18271bd2-6669-4f96-a756-029793e795bc {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:20 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-18271bd2-6669-4f96-a756-029793e795bc Sep 05 05:10:20 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:21 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d1e07b6c-e039-4bf2-aae1-e1b3738c8cbf tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-944cace7-43c4-4f25-ba6e-3e23c5192db8" returned: 0 in 1.195s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:21 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d1e07b6c-e039-4bf2-aae1-e1b3738c8cbf tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "cinder-quobyte-944cace7-43c4-4f25-ba6e-3e23c5192db8" released by "delete_volume" :: held 2.731s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:21 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-90057787-7d1a-4189-b1ec-9158d4461812 tempest-VolumesTransfersTest-1065980743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-18271bd2-6669-4f96-a756-029793e795bc" returned: 0 in 1.211s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:22 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-90057787-7d1a-4189-b1ec-9158d4461812 tempest-VolumesTransfersTest-1065980743 None] Lock "cinder-quobyte-18271bd2-6669-4f96-a756-029793e795bc" released by "delete_volume" :: held 2.519s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:22 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-d1e07b6c-e039-4bf2-aae1-e1b3738c8cbf tempest-VolumesSnapshotListTestJSON-728014487 None] Created reservations ['f31ce0d4-bf3d-42b7-a6b4-82c5a8801d30', '7e703a88-0d67-4aac-bd8b-f49358e13889', '42804205-6fd4-4c42-9197-1b973def4428', '7104ec2e-d7d0-4e97-aa1d-5a554065d584'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:10:22 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-90057787-7d1a-4189-b1ec-9158d4461812 tempest-VolumesTransfersTest-1065980743 None] Created reservations ['dfbbf88d-b9ec-4fea-891e-13c3fcd69b29', '16504f9e-9b1e-45ee-a7ed-bae42a414546', '1c6de18e-fcea-498a-b568-37e2359a449f', '3c3f554e-af91-46aa-9942-bc10819b9a41'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:10:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d1e07b6c-e039-4bf2-aae1-e1b3738c8cbf tempest-VolumesSnapshotListTestJSON-728014487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d1e07b6c-e039-4bf2-aae1-e1b3738c8cbf tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d1e07b6c-e039-4bf2-aae1-e1b3738c8cbf tempest-VolumesSnapshotListTestJSON-728014487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d1e07b6c-e039-4bf2-aae1-e1b3738c8cbf tempest-VolumesSnapshotListTestJSON-728014487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d1e07b6c-e039-4bf2-aae1-e1b3738c8cbf tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d1e07b6c-e039-4bf2-aae1-e1b3738c8cbf tempest-VolumesSnapshotListTestJSON-728014487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:22 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:10:22 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-90057787-7d1a-4189-b1ec-9158d4461812 tempest-VolumesTransfersTest-1065980743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-90057787-7d1a-4189-b1ec-9158d4461812 tempest-VolumesTransfersTest-1065980743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-90057787-7d1a-4189-b1ec-9158d4461812 tempest-VolumesTransfersTest-1065980743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-90057787-7d1a-4189-b1ec-9158d4461812 tempest-VolumesTransfersTest-1065980743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-90057787-7d1a-4189-b1ec-9158d4461812 tempest-VolumesTransfersTest-1065980743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-90057787-7d1a-4189-b1ec-9158d4461812 tempest-VolumesTransfersTest-1065980743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:23 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:10:23 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:23 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d1e07b6c-e039-4bf2-aae1-e1b3738c8cbf tempest-VolumesSnapshotListTestJSON-728014487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.541s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:23 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-d1e07b6c-e039-4bf2-aae1-e1b3738c8cbf tempest-VolumesSnapshotListTestJSON-728014487 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:10:23 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-d1e07b6c-e039-4bf2-aae1-e1b3738c8cbf tempest-VolumesSnapshotListTestJSON-728014487 None] Deleted volume successfully. Sep 05 05:10:23 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d1e07b6c-e039-4bf2-aae1-e1b3738c8cbf tempest-VolumesSnapshotListTestJSON-728014487 None] Lock "cinder-944cace7-43c4-4f25-ba6e-3e23c5192db8-delete_volume" released by "delete_volume" :: held 4.438s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:23 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-90057787-7d1a-4189-b1ec-9158d4461812 tempest-VolumesTransfersTest-1065980743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.616s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:23 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-90057787-7d1a-4189-b1ec-9158d4461812 tempest-VolumesTransfersTest-1065980743 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:10:23 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-90057787-7d1a-4189-b1ec-9158d4461812 tempest-VolumesTransfersTest-1065980743 None] Deleted volume successfully. Sep 05 05:10:23 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-90057787-7d1a-4189-b1ec-9158d4461812 tempest-VolumesTransfersTest-1065980743 None] Lock "cinder-18271bd2-6669-4f96-a756-029793e795bc-delete_volume" released by "delete_volume" :: held 4.312s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:25 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:10:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Flow 'volume_create_manager' (7a87e2f6-e2b0-419d-8060-c1f6de28d217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f1bd679-63fa-4252-8fcf-9c6db55858cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:25 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f1bd679-63fa-4252-8fcf-9c6db55858cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1342867596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b05b8c1-071d-4891-80c2-06b1de2ed915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82af3a6e535c4cef91746d6e1fddc1c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:25Z,use_quota=True,user_id='55ec7cb734e7403c988b5df953a57bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17e9b6c-8dce-4dc3-a6d0-469418dfacb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17e9b6c-8dce-4dc3-a6d0-469418dfacb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (530bdf23-6670-457f-ba2a-ab36a9cd2cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (530bdf23-6670-457f-ba2a-ab36a9cd2cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b05b8c1-071d-4891-80c2-06b1de2ed915', 'volume_name': 'volume-8b05b8c1-071d-4891-80c2-06b1de2ed915', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7747a6-c56e-4def-b7b4-417950562468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7747a6-c56e-4def-b7b4-417950562468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c0acbe-b2ac-42a8-a84c-3c11b71f1567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:25 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Volume 8b05b8c1-071d-4891-80c2-06b1de2ed915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b05b8c1-071d-4891-80c2-06b1de2ed915', 'volume_size': 1} Sep 05 05:10:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb" returned: 0 in 8.022s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:25 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57, size 1024.00 MB, duration 8.02 sec, destination /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:10:25 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Converted 1024.00 MB image at 127.62 MB/s Sep 05 05:10:25 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb is being set with open permissions: ugo+rw Sep 05 05:10:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:25 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb Sep 05 05:10:25 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:25 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb" returned: 0 in 0.372s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:25 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-quobyte-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb" released by "_copy_volume_from_snapshot" :: held 9.507s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:26 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-quobyte-71b683c5-7aaa-48c9-bfdd-55076a39d0c3-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb" released by "_create_volume_from_snapshot" :: held 9.639s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.658s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.477s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1342867596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b05b8c1-071d-4891-80c2-06b1de2ed915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82af3a6e535c4cef91746d6e1fddc1c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:25Z,use_quota=True,user_id='55ec7cb734e7403c988b5df953a57bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:10:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Creating volume 8b05b8c1-071d-4891-80c2-06b1de2ed915 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:10:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:10:26 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:10:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8b05b8c1-071d-4891-80c2-06b1de2ed915 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:26 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8b05b8c1-071d-4891-80c2-06b1de2ed915 1073741824 Sep 05 05:10:26 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f248608-35fb-4181-8641-12971aab51ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb', 'volume_size': 1, 'snapshot_id': '71b683c5-7aaa-48c9-bfdd-55076a39d0c3'}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e388ccd2-13f7-4739-aebf-5e9fea125416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:26 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Volume volume-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb (25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb): created successfully Sep 05 05:10:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e388ccd2-13f7-4739-aebf-5e9fea125416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Flow 'volume_create_manager' (1a7dca35-81b8-4c0c-b6e2-8646cdac5fd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:26 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-97065fe4-3e8f-4c12-9b7d-97c7975d7250 tempest-VolumesDeleteCascade-1299616072 None] Created volume successfully. Sep 05 05:10:26 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8b05b8c1-071d-4891-80c2-06b1de2ed915 1073741824" returned: 0 in 0.790s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:26 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "cinder-f9000b8c-335a-4471-8c13-14555610cb57-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8b05b8c1-071d-4891-80c2-06b1de2ed915 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:26 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-f9000b8c-335a-4471-8c13-14555610cb57-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:27 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8b05b8c1-071d-4891-80c2-06b1de2ed915 Sep 05 05:10:27 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Performing cascade delete. {{(pid=89331) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 05 05:10:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "cinder-71b683c5-7aaa-48c9-bfdd-55076a39d0c3-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-71b683c5-7aaa-48c9-bfdd-55076a39d0c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "cinder-quobyte-f9000b8c-335a-4471-8c13-14555610cb57" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-quobyte-f9000b8c-335a-4471-8c13-14555610cb57" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:27 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "cinder-quobyte-71b683c5-7aaa-48c9-bfdd-55076a39d0c3" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8b05b8c1-071d-4891-80c2-06b1de2ed915" returned: 0 in 0.358s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:10:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c0acbe-b2ac-42a8-a84c-3c11b71f1567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b05b8c1-071d-4891-80c2-06b1de2ed915', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4a25f4-ab74-49f5-b0cb-f62082471c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-quobyte-71b683c5-7aaa-48c9-bfdd-55076a39d0c3" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Deleting offline snapshot 71b683c5-7aaa-48c9-bfdd-55076a39d0c3 of volume f9000b8c-335a-4471-8c13-14555610cb57 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:10:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] snapshot_file for this snap is: volume-f9000b8c-335a-4471-8c13-14555610cb57.71b683c5-7aaa-48c9-bfdd-55076a39d0c3 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:10:27 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Volume volume-8b05b8c1-071d-4891-80c2-06b1de2ed915 (8b05b8c1-071d-4891-80c2-06b1de2ed915): created successfully Sep 05 05:10:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4a25f4-ab74-49f5-b0cb-f62082471c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Flow 'volume_create_manager' (7a87e2f6-e2b0-419d-8060-c1f6de28d217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:27 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aae723c-052c-4a33-a827-6fb75b3acbf9]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.71b683c5-7aaa-48c9-bfdd-55076a39d0c3 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:27 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-7a2a0e53-ad61-4cef-aa39-87e751fa0038 tempest-VolumesTransfersTest-1457384829 None] Created volume successfully. Sep 05 05:10:27 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.71b683c5-7aaa-48c9-bfdd-55076a39d0c3 Sep 05 05:10:27 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:27 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.71b683c5-7aaa-48c9-bfdd-55076a39d0c3" returned: 0 in 0.538s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9000b8c-335a-4471-8c13-14555610cb57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:10:28 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf77fea-d26c-4e8d-8b9b-a8ec3920db98]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-017ad7d1-bf46-4636-89f4-aa16aa32c4f0 tempest-VolumesTransfersTest-1065980743 None] Acquiring lock "cinder-8b05b8c1-071d-4891-80c2-06b1de2ed915-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-017ad7d1-bf46-4636-89f4-aa16aa32c4f0 tempest-VolumesTransfersTest-1065980743 None] Lock "cinder-8b05b8c1-071d-4891-80c2-06b1de2ed915-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:28 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57 Sep 05 05:10:28 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-017ad7d1-bf46-4636-89f4-aa16aa32c4f0 tempest-VolumesTransfersTest-1065980743 None] Acquiring lock "cinder-quobyte-8b05b8c1-071d-4891-80c2-06b1de2ed915" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-017ad7d1-bf46-4636-89f4-aa16aa32c4f0 tempest-VolumesTransfersTest-1065980743 None] Lock "cinder-quobyte-8b05b8c1-071d-4891-80c2-06b1de2ed915" acquired by "delete_volume" :: waited 0.048s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:28 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6d1ef8-73e3-4b70-9365-b55920c51199]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-017ad7d1-bf46-4636-89f4-aa16aa32c4f0 tempest-VolumesTransfersTest-1065980743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8b05b8c1-071d-4891-80c2-06b1de2ed915 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:28 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8b05b8c1-071d-4891-80c2-06b1de2ed915 Sep 05 05:10:28 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:28 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57" returned: 0 in 0.771s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.71b683c5-7aaa-48c9-bfdd-55076a39d0c3 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:28 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.71b683c5-7aaa-48c9-bfdd-55076a39d0c3 Sep 05 05:10:28 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:28 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-017ad7d1-bf46-4636-89f4-aa16aa32c4f0 tempest-VolumesTransfersTest-1065980743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8b05b8c1-071d-4891-80c2-06b1de2ed915" returned: 0 in 0.507s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-017ad7d1-bf46-4636-89f4-aa16aa32c4f0 tempest-VolumesTransfersTest-1065980743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8b05b8c1-071d-4891-80c2-06b1de2ed915 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:28 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8b05b8c1-071d-4891-80c2-06b1de2ed915 Sep 05 05:10:28 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:29 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.71b683c5-7aaa-48c9-bfdd-55076a39d0c3" returned: 0 in 0.404s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.71b683c5-7aaa-48c9-bfdd-55076a39d0c3 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:29 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-017ad7d1-bf46-4636-89f4-aa16aa32c4f0 tempest-VolumesTransfersTest-1065980743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8b05b8c1-071d-4891-80c2-06b1de2ed915" returned: 0 in 0.291s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:29 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.71b683c5-7aaa-48c9-bfdd-55076a39d0c3 Sep 05 05:10:29 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-017ad7d1-bf46-4636-89f4-aa16aa32c4f0 tempest-VolumesTransfersTest-1065980743 None] Lock "cinder-quobyte-8b05b8c1-071d-4891-80c2-06b1de2ed915" released by "delete_volume" :: held 0.877s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-017ad7d1-bf46-4636-89f4-aa16aa32c4f0 tempest-VolumesTransfersTest-1065980743 None] Created reservations ['b0ff0182-6b15-46cd-90a2-6a47982118bc', '8d0a32ab-4076-4a77-a241-e5306a912c53', 'b9c36678-77eb-4986-a2eb-51495f944efa', 'c36e0495-6333-41a3-9935-fae817796e29'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-017ad7d1-bf46-4636-89f4-aa16aa32c4f0 tempest-VolumesTransfersTest-1065980743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-017ad7d1-bf46-4636-89f4-aa16aa32c4f0 tempest-VolumesTransfersTest-1065980743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-017ad7d1-bf46-4636-89f4-aa16aa32c4f0 tempest-VolumesTransfersTest-1065980743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-017ad7d1-bf46-4636-89f4-aa16aa32c4f0 tempest-VolumesTransfersTest-1065980743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-017ad7d1-bf46-4636-89f4-aa16aa32c4f0 tempest-VolumesTransfersTest-1065980743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-017ad7d1-bf46-4636-89f4-aa16aa32c4f0 tempest-VolumesTransfersTest-1065980743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:29 devstack sudo[99460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:10:29 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:29 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57.71b683c5-7aaa-48c9-bfdd-55076a39d0c3" returned: 0 in 0.281s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-quobyte-71b683c5-7aaa-48c9-bfdd-55076a39d0c3" released by "_delete_snapshot" :: held 2.180s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-quobyte-f9000b8c-335a-4471-8c13-14555610cb57" released by "delete_snapshot" :: held 2.230s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Created reservations ['461a52c6-177f-4509-b671-7a639936d35a', 'b187e741-e38a-4a5b-938e-e80e2ecbbc58', '030abb1c-960a-435a-859a-a23af839d0bb', '1ef06e75-30ee-46c5-a8ef-d39111a13b36'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:10:29 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Delete snapshot completed successfully. Sep 05 05:10:29 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-71b683c5-7aaa-48c9-bfdd-55076a39d0c3-delete_snapshot" released by "delete_snapshot" :: held 2.572s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Snapshots deleted, issuing volume delete {{(pid=89331) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "cinder-quobyte-f9000b8c-335a-4471-8c13-14555610cb57" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-017ad7d1-bf46-4636-89f4-aa16aa32c4f0 tempest-VolumesTransfersTest-1065980743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.312s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-017ad7d1-bf46-4636-89f4-aa16aa32c4f0 tempest-VolumesTransfersTest-1065980743 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-quobyte-f9000b8c-335a-4471-8c13-14555610cb57" acquired by "delete_volume" :: waited 0.024s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:29 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-017ad7d1-bf46-4636-89f4-aa16aa32c4f0 tempest-VolumesTransfersTest-1065980743 None] Deleted volume successfully. Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b9421d-660d-4d36-8641-75bae265eac6]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-017ad7d1-bf46-4636-89f4-aa16aa32c4f0 tempest-VolumesTransfersTest-1065980743 None] Lock "cinder-8b05b8c1-071d-4891-80c2-06b1de2ed915-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:29 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57 Sep 05 05:10:29 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:30 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57" returned: 0 in 0.419s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:30 devstack sudo[99469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57 Sep 05 05:10:30 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:30 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9000b8c-335a-4471-8c13-14555610cb57" returned: 0 in 0.287s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-quobyte-f9000b8c-335a-4471-8c13-14555610cb57" released by "delete_volume" :: held 0.796s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:30 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Created reservations ['a603b586-6370-4b85-8c4b-04c8744505e4', '76fcc8ff-0bc0-4daa-b1ed-fa5a665f4ab4', '092235e8-b144-4960-bf24-16f94863fff9', '49778959-8d2b-4411-baeb-81f45525fd82'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:10:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:30 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:30 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:30 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:10:30 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:31 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.365s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:10:31 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Deleted volume successfully. Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ab9b2e92-f012-49a8-ba0d-76487eff3e71 tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-f9000b8c-335a-4471-8c13-14555610cb57-delete_volume" released by "delete_volume" :: held 4.111s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Flow 'volume_create_manager' (8f4b71a0-fc05-4214-9969-854933387c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b175b245-4dc9-4e5b-a645-05ba7020070b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b175b245-4dc9-4e5b-a645-05ba7020070b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2083980420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3490d187-5413-434a-9489-15a092f123ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7963eece52f484ab6c16497dd04d8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:31Z,use_quota=True,user_id='8381d292c65b4d1aa98755241377f5f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9375fc-1855-4d7b-9959-dd73d7dcdc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9375fc-1855-4d7b-9959-dd73d7dcdc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b512aa7c-814f-4e81-8ac3-6673b5dd4a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b512aa7c-814f-4e81-8ac3-6673b5dd4a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3490d187-5413-434a-9489-15a092f123ee', 'volume_name': 'volume-3490d187-5413-434a-9489-15a092f123ee', 'volume_size': 2}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01959e7-96bf-457e-aa84-a2508340f085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01959e7-96bf-457e-aa84-a2508340f085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ab184e3-e339-4a14-8efe-9acad24277f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:31 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Volume 3490d187-5413-434a-9489-15a092f123ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3490d187-5413-434a-9489-15a092f123ee', 'volume_size': 2} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2083980420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3490d187-5413-434a-9489-15a092f123ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7963eece52f484ab6c16497dd04d8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:31Z,use_quota=True,user_id='8381d292c65b4d1aa98755241377f5f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Creating volume 3490d187-5413-434a-9489-15a092f123ee {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:10:31 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee 2147483648 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:31 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee 2147483648 Sep 05 05:10:31 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-61a81815-b07b-4701-940f-9118d622c7ad tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "cinder-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-61a81815-b07b-4701-940f-9118d622c7ad tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-61a81815-b07b-4701-940f-9118d622c7ad tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "cinder-quobyte-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-61a81815-b07b-4701-940f-9118d622c7ad tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-quobyte-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb" acquired by "delete_volume" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58d8234-bb33-4f95-9556-239b4b630e38]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-61a81815-b07b-4701-940f-9118d622c7ad tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:31 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb Sep 05 05:10:31 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:32 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee 2147483648" returned: 0 in 0.700s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:32 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee Sep 05 05:10:32 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:32 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-61a81815-b07b-4701-940f-9118d622c7ad tempest-VolumesDeleteCascade-1299616072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb" returned: 0 in 0.527s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-61a81815-b07b-4701-940f-9118d622c7ad tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:32 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb Sep 05 05:10:32 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:32 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee" returned: 0 in 0.298s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:32 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:10:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:32 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ab184e3-e339-4a14-8efe-9acad24277f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3490d187-5413-434a-9489-15a092f123ee', 'volume_size': 2}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:32 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b72e72-bace-4dc1-9dd9-013afa1f0a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:32 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Volume volume-3490d187-5413-434a-9489-15a092f123ee (3490d187-5413-434a-9489-15a092f123ee): created successfully Sep 05 05:10:32 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b72e72-bace-4dc1-9dd9-013afa1f0a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:32 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Flow 'volume_create_manager' (8f4b71a0-fc05-4214-9969-854933387c47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:32 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-4e0e927e-a4c9-47bc-8abd-de2293a1e86f tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Created volume successfully. Sep 05 05:10:32 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-61a81815-b07b-4701-940f-9118d622c7ad tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb" returned: 0 in 0.306s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:32 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-61a81815-b07b-4701-940f-9118d622c7ad tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-quobyte-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb" released by "delete_volume" :: held 0.889s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:32 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-61a81815-b07b-4701-940f-9118d622c7ad tempest-VolumesDeleteCascade-1299616072 None] Created reservations ['052c96e0-8abb-4d59-9e2e-332d51436ffe', 'c8b1246a-8dc3-453d-81ad-0782175a568a', 'cc59327c-19b1-40f9-9cd6-3f18fa14948f', 'b4d99822-8c3c-4f93-b0a1-2c708c3ed331'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:10:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-61a81815-b07b-4701-940f-9118d622c7ad tempest-VolumesDeleteCascade-1299616072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-61a81815-b07b-4701-940f-9118d622c7ad tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:32 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-61a81815-b07b-4701-940f-9118d622c7ad tempest-VolumesDeleteCascade-1299616072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:32 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-61a81815-b07b-4701-940f-9118d622c7ad tempest-VolumesDeleteCascade-1299616072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-61a81815-b07b-4701-940f-9118d622c7ad tempest-VolumesDeleteCascade-1299616072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-61a81815-b07b-4701-940f-9118d622c7ad tempest-VolumesDeleteCascade-1299616072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:32 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:10:32 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:33 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-61a81815-b07b-4701-940f-9118d622c7ad tempest-VolumesDeleteCascade-1299616072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.294s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:33 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-61a81815-b07b-4701-940f-9118d622c7ad tempest-VolumesDeleteCascade-1299616072 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:10:33 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-61a81815-b07b-4701-940f-9118d622c7ad tempest-VolumesDeleteCascade-1299616072 None] Deleted volume successfully. Sep 05 05:10:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-61a81815-b07b-4701-940f-9118d622c7ad tempest-VolumesDeleteCascade-1299616072 None] Lock "cinder-25a0ae08-3ca2-42bf-b80e-6ca8c3761dbb-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fa70edf0-d5c1-4599-b9b9-abda00b78967 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fa70edf0-d5c1-4599-b9b9-abda00b78967 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-fa70edf0-d5c1-4599-b9b9-abda00b78967 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Creating offline snapshot 5e596428-e59c-4f90-aca9-12639a7b3cae of volume 3490d187-5413-434a-9489-15a092f123ee {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:10:33 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccd8555-4e10-48b8-82fd-ff418255f9a5]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa70edf0-d5c1-4599-b9b9-abda00b78967 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:33 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee Sep 05 05:10:33 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:34 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa70edf0-d5c1-4599-b9b9-abda00b78967 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee" returned: 0 in 0.502s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa70edf0-d5c1-4599-b9b9-abda00b78967 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.5e596428-e59c-4f90-aca9-12639a7b3cae 2G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:34 devstack sudo[99502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.5e596428-e59c-4f90-aca9-12639a7b3cae 2G Sep 05 05:10:34 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:34 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa70edf0-d5c1-4599-b9b9-abda00b78967 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.5e596428-e59c-4f90-aca9-12639a7b3cae 2G" returned: 0 in 0.556s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa70edf0-d5c1-4599-b9b9-abda00b78967 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3490d187-5413-434a-9489-15a092f123ee -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.5e596428-e59c-4f90-aca9-12639a7b3cae {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:34 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3490d187-5413-434a-9489-15a092f123ee -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.5e596428-e59c-4f90-aca9-12639a7b3cae Sep 05 05:10:34 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:35 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa70edf0-d5c1-4599-b9b9-abda00b78967 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3490d187-5413-434a-9489-15a092f123ee -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.5e596428-e59c-4f90-aca9-12639a7b3cae" returned: 0 in 0.346s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:35 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-fa70edf0-d5c1-4599-b9b9-abda00b78967 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.5e596428-e59c-4f90-aca9-12639a7b3cae is being set with open permissions: ugo+rw Sep 05 05:10:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa70edf0-d5c1-4599-b9b9-abda00b78967 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.5e596428-e59c-4f90-aca9-12639a7b3cae {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:35 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.5e596428-e59c-4f90-aca9-12639a7b3cae Sep 05 05:10:35 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:35 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa70edf0-d5c1-4599-b9b9-abda00b78967 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.5e596428-e59c-4f90-aca9-12639a7b3cae" returned: 0 in 0.273s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa70edf0-d5c1-4599-b9b9-abda00b78967 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:35 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.info Sep 05 05:10:35 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:35 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa70edf0-d5c1-4599-b9b9-abda00b78967 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.info" returned: 0 in 0.285s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:35 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-fa70edf0-d5c1-4599-b9b9-abda00b78967 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.info is being set with open permissions: ugo+rw Sep 05 05:10:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa70edf0-d5c1-4599-b9b9-abda00b78967 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:35 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.info Sep 05 05:10:35 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:35 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa70edf0-d5c1-4599-b9b9-abda00b78967 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.info" returned: 0 in 0.257s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fa70edf0-d5c1-4599-b9b9-abda00b78967 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.319s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:35 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-fa70edf0-d5c1-4599-b9b9-abda00b78967 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Create snapshot completed successfully Sep 05 05:10:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-749e88be-ae12-43c3-aa40-75d47ef96d05 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Acquiring lock "cinder-5e596428-e59c-4f90-aca9-12639a7b3cae-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-749e88be-ae12-43c3-aa40-75d47ef96d05 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Lock "cinder-5e596428-e59c-4f90-aca9-12639a7b3cae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-749e88be-ae12-43c3-aa40-75d47ef96d05 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Acquiring lock "cinder-quobyte-3490d187-5413-434a-9489-15a092f123ee" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-749e88be-ae12-43c3-aa40-75d47ef96d05 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Lock "cinder-quobyte-3490d187-5413-434a-9489-15a092f123ee" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-749e88be-ae12-43c3-aa40-75d47ef96d05 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Acquiring lock "cinder-quobyte-5e596428-e59c-4f90-aca9-12639a7b3cae" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-749e88be-ae12-43c3-aa40-75d47ef96d05 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Lock "cinder-quobyte-5e596428-e59c-4f90-aca9-12639a7b3cae" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:36 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-749e88be-ae12-43c3-aa40-75d47ef96d05 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Deleting offline snapshot 5e596428-e59c-4f90-aca9-12639a7b3cae of volume 3490d187-5413-434a-9489-15a092f123ee {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:10:36 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-749e88be-ae12-43c3-aa40-75d47ef96d05 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] snapshot_file for this snap is: volume-3490d187-5413-434a-9489-15a092f123ee.5e596428-e59c-4f90-aca9-12639a7b3cae {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:10:37 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6741d69a-5788-40e8-9072-57335b2f2169]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-749e88be-ae12-43c3-aa40-75d47ef96d05 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.5e596428-e59c-4f90-aca9-12639a7b3cae {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:37 devstack sudo[99523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.5e596428-e59c-4f90-aca9-12639a7b3cae Sep 05 05:10:37 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:37 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-749e88be-ae12-43c3-aa40-75d47ef96d05 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.5e596428-e59c-4f90-aca9-12639a7b3cae" returned: 0 in 0.540s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:37 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-749e88be-ae12-43c3-aa40-75d47ef96d05 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3490d187-5413-434a-9489-15a092f123ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:10:37 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c2afbd-c3cc-491d-8c35-7ef0f9b16d51]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-749e88be-ae12-43c3-aa40-75d47ef96d05 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:37 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee Sep 05 05:10:37 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:38 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-749e88be-ae12-43c3-aa40-75d47ef96d05 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee" returned: 0 in 0.500s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-749e88be-ae12-43c3-aa40-75d47ef96d05 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.5e596428-e59c-4f90-aca9-12639a7b3cae {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:38 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.5e596428-e59c-4f90-aca9-12639a7b3cae Sep 05 05:10:38 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:38 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-749e88be-ae12-43c3-aa40-75d47ef96d05 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.5e596428-e59c-4f90-aca9-12639a7b3cae" returned: 0 in 0.546s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-749e88be-ae12-43c3-aa40-75d47ef96d05 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.5e596428-e59c-4f90-aca9-12639a7b3cae {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:38 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:UPDATE=196,cinder:SELECT=165,cinder:INSERT=48,cinder:DELETE=15 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:10:38 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.5e596428-e59c-4f90-aca9-12639a7b3cae Sep 05 05:10:38 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:38 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=149,cinder:INSERT=51,cinder:UPDATE=196,cinder:DELETE=20 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:10:38 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:10:38 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Flow 'volume_create_manager' (87b7e213-8897-414e-96e5-c50e155a6364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:38 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea422491-789c-434e-8d5b-735943ff96d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:38 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea422491-789c-434e-8d5b-735943ff96d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1040094995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d872270-1ab9-4959-8974-88d152b1d69f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880c2a8d804c4315be332d6929478100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:39Z,use_quota=True,user_id='6030fcb0f0544fc28ec0bd8aa3a5bdd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:38 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8881a11-33ce-4995-8265-e6e65ce0212a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:38 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8881a11-33ce-4995-8265-e6e65ce0212a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:38 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de22075-569e-4283-a9b1-3c634b8312e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:38 devstack cinder-volume[89331]: DEBUG cinder.image.glance [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Creating Keystone auth plugin from conf {{(pid=89331) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 05:10:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6e2e57b6-9d1e-4374-ad40-328791ba149e tempest-VolumesNegativeTest-346893649 None] Acquiring lock "cinder-caac8115-7f2e-4891-b6c4-9b0c7cf8378f-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6e2e57b6-9d1e-4374-ad40-328791ba149e tempest-VolumesNegativeTest-346893649 None] Lock "cinder-caac8115-7f2e-4891-b6c4-9b0c7cf8378f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6e2e57b6-9d1e-4374-ad40-328791ba149e tempest-VolumesNegativeTest-346893649 None] Acquiring lock "cinder-quobyte-caac8115-7f2e-4891-b6c4-9b0c7cf8378f" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6e2e57b6-9d1e-4374-ad40-328791ba149e tempest-VolumesNegativeTest-346893649 None] Lock "cinder-quobyte-caac8115-7f2e-4891-b6c4-9b0c7cf8378f" acquired by "delete_volume" :: waited 0.025s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:38 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e371f94-4646-4b11-9fb7-b45415e125ae]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6e2e57b6-9d1e-4374-ad40-328791ba149e tempest-VolumesNegativeTest-346893649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-caac8115-7f2e-4891-b6c4-9b0c7cf8378f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:38 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-749e88be-ae12-43c3-aa40-75d47ef96d05 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee.5e596428-e59c-4f90-aca9-12639a7b3cae" returned: 0 in 0.313s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:39 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-749e88be-ae12-43c3-aa40-75d47ef96d05 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Lock "cinder-quobyte-5e596428-e59c-4f90-aca9-12639a7b3cae" released by "_delete_snapshot" :: held 2.067s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:39 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-749e88be-ae12-43c3-aa40-75d47ef96d05 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Lock "cinder-quobyte-3490d187-5413-434a-9489-15a092f123ee" released by "delete_snapshot" :: held 2.103s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:39 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-caac8115-7f2e-4891-b6c4-9b0c7cf8378f Sep 05 05:10:39 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de22075-569e-4283-a9b1-3c634b8312e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5d872270-1ab9-4959-8974-88d152b1d69f', 'volume_name': 'volume-5d872270-1ab9-4959-8974-88d152b1d69f', 'volume_size': 1, 'image_id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '06b067117d184688bd2e16e21ff323f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'created_at': datetime.datetime(2026, 9, 5, 2, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 55, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf4d80c-76aa-40f1-b068-3048bf057086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf4d80c-76aa-40f1-b068-3048bf057086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (003a38f6-2a7c-47e4-a0be-fcac99c49942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:39 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Volume 5d872270-1ab9-4959-8974-88d152b1d69f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5d872270-1ab9-4959-8974-88d152b1d69f', 'volume_size': 1, 'image_id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '06b067117d184688bd2e16e21ff323f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'created_at': datetime.datetime(2026, 9, 5, 2, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 55, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 05:10:39 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Trying to clone 5d872270-1ab9-4959-8974-88d152b1d69f from image a60f4e58-9471-4dd7-bff3-114bdbd77a8d at location (None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}]). {{(pid=89331) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 05:10:39 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-749e88be-ae12-43c3-aa40-75d47ef96d05 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Created reservations ['373b543c-19ce-453f-af44-92f6de01c2b8', '24fcd128-7841-4e7c-ab04-83d76c4c3b4c', '527253db-0696-4afb-8e35-306353311c95', '68f5a344-68c0-4782-85dc-b8857ea091ee'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:10:39 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-749e88be-ae12-43c3-aa40-75d47ef96d05 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Delete snapshot completed successfully. Sep 05 05:10:39 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-749e88be-ae12-43c3-aa40-75d47ef96d05 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Lock "cinder-5e596428-e59c-4f90-aca9-12639a7b3cae-delete_snapshot" released by "delete_snapshot" :: held 2.405s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:39 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6e2e57b6-9d1e-4374-ad40-328791ba149e tempest-VolumesNegativeTest-346893649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-caac8115-7f2e-4891-b6c4-9b0c7cf8378f" returned: 0 in 0.469s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6e2e57b6-9d1e-4374-ad40-328791ba149e tempest-VolumesNegativeTest-346893649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-caac8115-7f2e-4891-b6c4-9b0c7cf8378f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:39 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-caac8115-7f2e-4891-b6c4-9b0c7cf8378f Sep 05 05:10:39 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:39 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_jf0pa9mydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 05:10:39 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Image download 20.69 MB at 20.69 MB/s Sep 05 05:10:39 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a06140b-c581-4b35-b716-37a05760007e]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_jf0pa9mydevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:39 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6e2e57b6-9d1e-4374-ad40-328791ba149e tempest-VolumesNegativeTest-346893649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-caac8115-7f2e-4891-b6c4-9b0c7cf8378f" returned: 0 in 0.319s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:39 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6e2e57b6-9d1e-4374-ad40-328791ba149e tempest-VolumesNegativeTest-346893649 None] Lock "cinder-quobyte-caac8115-7f2e-4891-b6c4-9b0c7cf8378f" released by "delete_volume" :: held 0.838s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:39 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_jf0pa9mydevstack@QuobyteHD Sep 05 05:10:39 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:39 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-6e2e57b6-9d1e-4374-ad40-328791ba149e tempest-VolumesNegativeTest-346893649 None] Created reservations ['f133d1be-651a-42ec-8de2-252b12f5f1a4', '7479674c-c256-4790-bf13-1107ea55d026', 'b56d6df8-a7be-4103-8922-35d385bdfba2', 'f01a9e98-d22b-4b44-8ae7-648ff63a7292'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:10:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6e2e57b6-9d1e-4374-ad40-328791ba149e tempest-VolumesNegativeTest-346893649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6e2e57b6-9d1e-4374-ad40-328791ba149e tempest-VolumesNegativeTest-346893649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6e2e57b6-9d1e-4374-ad40-328791ba149e tempest-VolumesNegativeTest-346893649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6e2e57b6-9d1e-4374-ad40-328791ba149e tempest-VolumesNegativeTest-346893649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6e2e57b6-9d1e-4374-ad40-328791ba149e tempest-VolumesNegativeTest-346893649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6e2e57b6-9d1e-4374-ad40-328791ba149e tempest-VolumesNegativeTest-346893649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:39 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:10:39 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:40 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_jf0pa9mydevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Temporary image a60f4e58-9471-4dd7-bff3-114bdbd77a8d is fetched for user 6030fcb0f0544fc28ec0bd8aa3a5bdd7. {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 05:10:40 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6e2e57b6-9d1e-4374-ad40-328791ba149e tempest-VolumesNegativeTest-346893649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.301s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-6e2e57b6-9d1e-4374-ad40-328791ba149e tempest-VolumesNegativeTest-346893649 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:10:40 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-6e2e57b6-9d1e-4374-ad40-328791ba149e tempest-VolumesNegativeTest-346893649 None] Deleted volume successfully. Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2065788d-5f23-4a13-8e07-32a6321c1771]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_jf0pa9mydevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6e2e57b6-9d1e-4374-ad40-328791ba149e tempest-VolumesNegativeTest-346893649 None] Lock "cinder-caac8115-7f2e-4891-b6c4-9b0c7cf8378f-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-580fd945-acdc-4b20-ae56-4f7a0f4f4ff0 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Acquiring lock "cinder-3490d187-5413-434a-9489-15a092f123ee-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-580fd945-acdc-4b20-ae56-4f7a0f4f4ff0 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Lock "cinder-3490d187-5413-434a-9489-15a092f123ee-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:40 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_jf0pa9mydevstack@QuobyteHD Sep 05 05:10:40 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-580fd945-acdc-4b20-ae56-4f7a0f4f4ff0 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Acquiring lock "cinder-quobyte-3490d187-5413-434a-9489-15a092f123ee" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-580fd945-acdc-4b20-ae56-4f7a0f4f4ff0 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Lock "cinder-quobyte-3490d187-5413-434a-9489-15a092f123ee" acquired by "delete_volume" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c4b603-f005-41f2-9f4a-9ff9eaad67e8]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-580fd945-acdc-4b20-ae56-4f7a0f4f4ff0 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:40 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:40 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee Sep 05 05:10:40 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_jf0pa9mydevstack@QuobyteHD" returned: 0 in 0.440s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1040094995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d872270-1ab9-4959-8974-88d152b1d69f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880c2a8d804c4315be332d6929478100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:39Z,use_quota=True,user_id='6030fcb0f0544fc28ec0bd8aa3a5bdd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Creating volume 5d872270-1ab9-4959-8974-88d152b1d69f {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:10:40 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:40 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f 1073741824 Sep 05 05:10:40 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:40 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-580fd945-acdc-4b20-ae56-4f7a0f4f4ff0 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee" returned: 0 in 0.495s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-580fd945-acdc-4b20-ae56-4f7a0f4f4ff0 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:41 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee Sep 05 05:10:41 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:41 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f 1073741824" returned: 0 in 0.571s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:41 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-580fd945-acdc-4b20-ae56-4f7a0f4f4ff0 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3490d187-5413-434a-9489-15a092f123ee" returned: 0 in 0.334s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-580fd945-acdc-4b20-ae56-4f7a0f4f4ff0 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Lock "cinder-quobyte-3490d187-5413-434a-9489-15a092f123ee" released by "delete_volume" :: held 0.904s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:41 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f Sep 05 05:10:41 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:41 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-580fd945-acdc-4b20-ae56-4f7a0f4f4ff0 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Created reservations ['a6fe4ae5-d18f-4cab-b6e4-c5a11dcd69f2', 'be47f7e6-163d-4ad9-ab73-b8b490b5dbb0', 'ac7e6416-5e45-45c3-9fff-541f8af11664', '7f76efbc-e426-4f18-809d-432b480063c0'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:10:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-580fd945-acdc-4b20-ae56-4f7a0f4f4ff0 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-580fd945-acdc-4b20-ae56-4f7a0f4f4ff0 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:41 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-580fd945-acdc-4b20-ae56-4f7a0f4f4ff0 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:41 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-580fd945-acdc-4b20-ae56-4f7a0f4f4ff0 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-580fd945-acdc-4b20-ae56-4f7a0f4f4ff0 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-580fd945-acdc-4b20-ae56-4f7a0f4f4ff0 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:41 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:10:41 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:41 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f" returned: 0 in 0.327s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:41 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:10:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:41 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Attempting download of a60f4e58-9471-4dd7-bff3-114bdbd77a8d ((None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}])) to volume 5d872270-1ab9-4959-8974-88d152b1d69f. {{(pid=89331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 05:10:41 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9ada8c-5f13-479b-9c19-f9d4e11b0254]: (4, 'raw') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_c417r_xn {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:41 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-580fd945-acdc-4b20-ae56-4f7a0f4f4ff0 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.333s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:41 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-580fd945-acdc-4b20-ae56-4f7a0f4f4ff0 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:10:41 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-580fd945-acdc-4b20-ae56-4f7a0f4f4ff0 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Deleted volume successfully. Sep 05 05:10:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-580fd945-acdc-4b20-ae56-4f7a0f4f4ff0 tempest-VolumesSnapshotNegativeTestJSON-369177001 None] Lock "cinder-3490d187-5413-434a-9489-15a092f123ee-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:41 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_c417r_xn Sep 05 05:10:41 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:42 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_c417r_xn" returned: 0 in 0.364s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_c417r_xn {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:42 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_c417r_xn Sep 05 05:10:42 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:42 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_c417r_xn" returned: 1 in 0.416s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_c417r_xn' failed. Not Retrying. {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 05:10:42 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c4d2a5-7dc8-43b2-afd7-3834ab344e1f]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_jf0pa9mydevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:42 devstack sudo[99597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_jf0pa9mydevstack@QuobyteHD Sep 05 05:10:42 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:42 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_jf0pa9mydevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:42 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] a60f4e58-9471-4dd7-bff3-114bdbd77a8d was qcow2, converting to qcow2 {{(pid=89331) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 05:10:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_jf0pa9mydevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:43 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_jf0pa9mydevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f Sep 05 05:10:43 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:45 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_jf0pa9mydevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f" returned: 0 in 2.086s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:45 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_jf0pa9mydevstack@QuobyteHD, size 112.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:10:45 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Converted 112.00 MB image at 53.65 MB/s Sep 05 05:10:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:45 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f 1G Sep 05 05:10:45 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:45 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f 1G" returned: 0 in 0.382s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:45 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Downloaded image a60f4e58-9471-4dd7-bff3-114bdbd77a8d ((None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}])) to volume 5d872270-1ab9-4959-8974-88d152b1d69f successfully. {{(pid=89331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 05:10:45 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Temporary image a60f4e58-9471-4dd7-bff3-114bdbd77a8d for user 6030fcb0f0544fc28ec0bd8aa3a5bdd7 is deleted. {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 05:10:45 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Marking volume 5d872270-1ab9-4959-8974-88d152b1d69f as bootable. {{(pid=89331) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 05:10:45 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Copying metadata from image a60f4e58-9471-4dd7-bff3-114bdbd77a8d to 5d872270-1ab9-4959-8974-88d152b1d69f. {{(pid=89331) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 05:10:45 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Creating volume glance metadata for volume 5d872270-1ab9-4959-8974-88d152b1d69f backed by image a60f4e58-9471-4dd7-bff3-114bdbd77a8d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89331) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 05:10:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (003a38f6-2a7c-47e4-a0be-fcac99c49942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d872270-1ab9-4959-8974-88d152b1d69f', 'volume_size': 1, 'image_id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '06b067117d184688bd2e16e21ff323f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'created_at': datetime.datetime(2026, 9, 5, 2, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 55, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9cb8ed-be40-4159-8b0a-54e5f889d5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:45 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Volume volume-5d872270-1ab9-4959-8974-88d152b1d69f (5d872270-1ab9-4959-8974-88d152b1d69f): created successfully Sep 05 05:10:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9cb8ed-be40-4159-8b0a-54e5f889d5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Flow 'volume_create_manager' (87b7e213-8897-414e-96e5-c50e155a6364) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:45 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-c36c73b7-bafb-4358-8860-ab3e6f821bf9 tempest-VolumesExtendTest-343820221 None] Created volume successfully. Sep 05 05:10:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1907d319-46d7-4a46-8aff-ed94b4d10a8b tempest-VolumesExtendTest-343820221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1907d319-46d7-4a46-8aff-ed94b4d10a8b tempest-VolumesExtendTest-343820221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:46 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dded02-08d1-4db8-964a-874df05f1301]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1907d319-46d7-4a46-8aff-ed94b4d10a8b tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:46 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f Sep 05 05:10:46 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:46 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1907d319-46d7-4a46-8aff-ed94b4d10a8b tempest-VolumesExtendTest-343820221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f" returned: 0 in 0.559s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1907d319-46d7-4a46-8aff-ed94b4d10a8b tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f 2G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1907d319-46d7-4a46-8aff-ed94b4d10a8b tempest-VolumesExtendTest-343820221 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f 2G" returned: 0 in 0.143s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1907d319-46d7-4a46-8aff-ed94b4d10a8b tempest-VolumesExtendTest-343820221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.740s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:47 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-1907d319-46d7-4a46-8aff-ed94b4d10a8b tempest-VolumesExtendTest-343820221 None] Extend volume completed successfully. Sep 05 05:10:47 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Flow 'volume_create_manager' (0bf08a07-a585-4efc-9396-b4e4d2b8543f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b75b260-4bb5-4ba5-a701-6fb20ffa80cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b75b260-4bb5-4ba5-a701-6fb20ffa80cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-344094523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39594f6f-d41b-4554-92a6-0fab8b4f7d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902ad28a23842c9998a541421977145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:48Z,use_quota=True,user_id='7b61f932f8164fe0a200c57fc6b9bcbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a120469-031d-4e9c-91a3-8fb699fe6729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a120469-031d-4e9c-91a3-8fb699fe6729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc347bbd-ff21-4cfd-afc2-95c14db96569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc347bbd-ff21-4cfd-afc2-95c14db96569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39594f6f-d41b-4554-92a6-0fab8b4f7d3f', 'volume_name': 'volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72181a09-b132-469d-90e8-27947fa62417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72181a09-b132-469d-90e8-27947fa62417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79d64dd-666e-4b81-8ed1-fca71f337cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:48 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Volume 39594f6f-d41b-4554-92a6-0fab8b4f7d3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f', 'volume_size': 1} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-344094523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39594f6f-d41b-4554-92a6-0fab8b4f7d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902ad28a23842c9998a541421977145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:48Z,use_quota=True,user_id='7b61f932f8164fe0a200c57fc6b9bcbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Creating volume 39594f6f-d41b-4554-92a6-0fab8b4f7d3f {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:10:48 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:48 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f 1073741824 Sep 05 05:10:48 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-70fe1bc7-0348-4046-a10c-0f73221db3bc tempest-VolumesExtendTest-343820221 None] Acquiring lock "cinder-5d872270-1ab9-4959-8974-88d152b1d69f-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-70fe1bc7-0348-4046-a10c-0f73221db3bc tempest-VolumesExtendTest-343820221 None] Lock "cinder-5d872270-1ab9-4959-8974-88d152b1d69f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-70fe1bc7-0348-4046-a10c-0f73221db3bc tempest-VolumesExtendTest-343820221 None] Acquiring lock "cinder-quobyte-5d872270-1ab9-4959-8974-88d152b1d69f" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-70fe1bc7-0348-4046-a10c-0f73221db3bc tempest-VolumesExtendTest-343820221 None] Lock "cinder-quobyte-5d872270-1ab9-4959-8974-88d152b1d69f" acquired by "delete_volume" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36a4f0e-f735-4b84-a000-76ab46fe4341]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-70fe1bc7-0348-4046-a10c-0f73221db3bc tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:48 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f Sep 05 05:10:48 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:48 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f 1073741824" returned: 0 in 0.583s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:48 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f Sep 05 05:10:48 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Flow 'volume_create_manager' (5596f6e4-53be-4ac3-9d84-98f547a1dfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054f70a2-9aca-4989-b0c5-77404187b783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054f70a2-9aca-4989-b0c5-77404187b783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1064529532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=089c8a8b-07d5-44b8-9fa4-04b189665cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9d54fd8d148404a9682b867d09a5055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:49Z,use_quota=True,user_id='5a25fea45bb345cb829e344c6ea16b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8231ac2-b6cb-4c67-b998-9b3ff26d1d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8231ac2-b6cb-4c67-b998-9b3ff26d1d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da7d552-231d-4020-9134-13a01698b4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da7d552-231d-4020-9134-13a01698b4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '089c8a8b-07d5-44b8-9fa4-04b189665cb0', 'volume_name': 'volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11a33c7-860e-4f90-b1f7-7a16b0e1b176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11a33c7-860e-4f90-b1f7-7a16b0e1b176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241d3b91-30e4-4713-b703-7b90948d27c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:48 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Volume 089c8a8b-07d5-44b8-9fa4-04b189665cb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0', 'volume_size': 1} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:48 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-70fe1bc7-0348-4046-a10c-0f73221db3bc tempest-VolumesExtendTest-343820221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f" returned: 0 in 0.487s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-70fe1bc7-0348-4046-a10c-0f73221db3bc tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:48 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f Sep 05 05:10:48 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:49 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f" returned: 0 in 0.308s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.133s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1064529532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=089c8a8b-07d5-44b8-9fa4-04b189665cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9d54fd8d148404a9682b867d09a5055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:49Z,use_quota=True,user_id='5a25fea45bb345cb829e344c6ea16b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Creating volume 089c8a8b-07d5-44b8-9fa4-04b189665cb0 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:10:49 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79d64dd-666e-4b81-8ed1-fca71f337cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0920f4d9-5cec-4747-9c08-0b3e81009ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:49 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0 1073741824 Sep 05 05:10:49 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:49 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Volume volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f (39594f6f-d41b-4554-92a6-0fab8b4f7d3f): created successfully Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0920f4d9-5cec-4747-9c08-0b3e81009ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Flow 'volume_create_manager' (0bf08a07-a585-4efc-9396-b4e4d2b8543f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:49 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-4cfb9bf3-b433-4ffa-aefc-4fa60e3dfeaf tempest-VolumesActionsTest-1530445118 None] Created volume successfully. Sep 05 05:10:49 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-70fe1bc7-0348-4046-a10c-0f73221db3bc tempest-VolumesExtendTest-343820221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5d872270-1ab9-4959-8974-88d152b1d69f" returned: 0 in 0.336s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-70fe1bc7-0348-4046-a10c-0f73221db3bc tempest-VolumesExtendTest-343820221 None] Lock "cinder-quobyte-5d872270-1ab9-4959-8974-88d152b1d69f" released by "delete_volume" :: held 0.868s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-70fe1bc7-0348-4046-a10c-0f73221db3bc tempest-VolumesExtendTest-343820221 None] Created reservations ['1fb90813-0101-4044-90b2-3d17ce4f599b', '324f9062-6777-4a7f-b360-09023cbb8e71', '645c11ce-e5e7-41e1-a2ca-ffa1a489177c', '6656020f-cad0-4aff-8bfe-142ecd63724d'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-70fe1bc7-0348-4046-a10c-0f73221db3bc tempest-VolumesExtendTest-343820221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-70fe1bc7-0348-4046-a10c-0f73221db3bc tempest-VolumesExtendTest-343820221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-70fe1bc7-0348-4046-a10c-0f73221db3bc tempest-VolumesExtendTest-343820221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-70fe1bc7-0348-4046-a10c-0f73221db3bc tempest-VolumesExtendTest-343820221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-70fe1bc7-0348-4046-a10c-0f73221db3bc tempest-VolumesExtendTest-343820221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-70fe1bc7-0348-4046-a10c-0f73221db3bc tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:49 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:10:49 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:49 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:10:49 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:49 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0 1073741824" returned: 0 in 0.616s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:49 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-70fe1bc7-0348-4046-a10c-0f73221db3bc tempest-VolumesExtendTest-343820221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.354s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-70fe1bc7-0348-4046-a10c-0f73221db3bc tempest-VolumesExtendTest-343820221 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:10:49 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0 Sep 05 05:10:49 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:49 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-70fe1bc7-0348-4046-a10c-0f73221db3bc tempest-VolumesExtendTest-343820221 None] Deleted volume successfully. Sep 05 05:10:49 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-70fe1bc7-0348-4046-a10c-0f73221db3bc tempest-VolumesExtendTest-343820221 None] Lock "cinder-5d872270-1ab9-4959-8974-88d152b1d69f-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:10:50 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.446s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager._thread_info {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread count: 28 {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread info: [<_MainThread(MainThread, started 139182109970560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 05:10:50 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0" returned: 0 in 0.335s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241d3b91-30e4-4713-b703-7b90948d27c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e41f0b-bce9-45b7-8009-72a0b2edaec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:50 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Volume volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0 (089c8a8b-07d5-44b8-9fa4-04b189665cb0): created successfully Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e41f0b-bce9-45b7-8009-72a0b2edaec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Flow 'volume_create_manager' (5596f6e4-53be-4ac3-9d84-98f547a1dfdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:50 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-39d313a4-140f-457b-b210-f78ca7087831 tempest-VolumeDependencyTests-884659083 None] Created volume successfully. Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Flow 'volume_create_manager' (c9a7e0d8-02a4-4077-8199-e8386d56c934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d8705d-f510-431c-90b5-318869a85e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d8705d-f510-431c-90b5-318869a85e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1947060108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5475cb34-bcbe-49d3-8b48-2e7fae4455b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880c2a8d804c4315be332d6929478100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:50Z,use_quota=True,user_id='6030fcb0f0544fc28ec0bd8aa3a5bdd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ac00ab-ceb8-49a2-8071-95252b3570f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ac00ab-ceb8-49a2-8071-95252b3570f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842b30e0-2bf5-4b9d-9cc6-a9364744d1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842b30e0-2bf5-4b9d-9cc6-a9364744d1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5475cb34-bcbe-49d3-8b48-2e7fae4455b0', 'volume_name': 'volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd7ec03-cade-468e-afe4-d6d76f028f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd7ec03-cade-468e-afe4-d6d76f028f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d050b20-fa11-4474-aaaa-aa7728fa4096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:50 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Volume 5475cb34-bcbe-49d3-8b48-2e7fae4455b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0', 'volume_size': 1} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1947060108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5475cb34-bcbe-49d3-8b48-2e7fae4455b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880c2a8d804c4315be332d6929478100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:50Z,use_quota=True,user_id='6030fcb0f0544fc28ec0bd8aa3a5bdd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Creating volume 5475cb34-bcbe-49d3-8b48-2e7fae4455b0 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:10:50 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:50 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0 1073741824 Sep 05 05:10:50 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:50 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0 1073741824" returned: 0 in 0.542s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:51 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0 Sep 05 05:10:51 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-bd91dfb6-c8b6-455b-964d-e289b98fc94b tempest-VolumeDependencyTests-884659083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:51 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0" returned: 0 in 0.392s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:10:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-bd91dfb6-c8b6-455b-964d-e289b98fc94b tempest-VolumeDependencyTests-884659083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.033s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d050b20-fa11-4474-aaaa-aa7728fa4096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96f5685-8e89-4a3a-b1ef-885f707a0f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-bd91dfb6-c8b6-455b-964d-e289b98fc94b tempest-VolumeDependencyTests-884659083 None] Creating offline snapshot 20d9d097-bfb0-4c91-baa1-037cea23edfc of volume 089c8a8b-07d5-44b8-9fa4-04b189665cb0 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:10:51 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Volume volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0 (5475cb34-bcbe-49d3-8b48-2e7fae4455b0): created successfully Sep 05 05:10:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96f5685-8e89-4a3a-b1ef-885f707a0f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Flow 'volume_create_manager' (c9a7e0d8-02a4-4077-8199-e8386d56c934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:51 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9663af-f3d7-4af1-b639-4b57d6324927]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bd91dfb6-c8b6-455b-964d-e289b98fc94b tempest-VolumeDependencyTests-884659083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:51 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-bf7e5d6c-f5f3-4d35-b051-52e712415e53 tempest-VolumesExtendTest-343820221 None] Created volume successfully. Sep 05 05:10:51 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0 Sep 05 05:10:51 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:51 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bd91dfb6-c8b6-455b-964d-e289b98fc94b tempest-VolumeDependencyTests-884659083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0" returned: 0 in 0.462s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bd91dfb6-c8b6-455b-964d-e289b98fc94b tempest-VolumeDependencyTests-884659083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.20d9d097-bfb0-4c91-baa1-037cea23edfc 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:51 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.20d9d097-bfb0-4c91-baa1-037cea23edfc 1G Sep 05 05:10:51 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:52 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bd91dfb6-c8b6-455b-964d-e289b98fc94b tempest-VolumeDependencyTests-884659083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.20d9d097-bfb0-4c91-baa1-037cea23edfc 1G" returned: 0 in 0.600s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bd91dfb6-c8b6-455b-964d-e289b98fc94b tempest-VolumeDependencyTests-884659083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.20d9d097-bfb0-4c91-baa1-037cea23edfc {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:52 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.20d9d097-bfb0-4c91-baa1-037cea23edfc Sep 05 05:10:52 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-aa9cb3fe-d977-4a44-92d0-c93508cbcaab tempest-VolumesExtendTest-343820221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:53 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bd91dfb6-c8b6-455b-964d-e289b98fc94b tempest-VolumeDependencyTests-884659083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.20d9d097-bfb0-4c91-baa1-037cea23edfc" returned: 0 in 0.504s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:53 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-bd91dfb6-c8b6-455b-964d-e289b98fc94b tempest-VolumeDependencyTests-884659083 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.20d9d097-bfb0-4c91-baa1-037cea23edfc is being set with open permissions: ugo+rw Sep 05 05:10:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bd91dfb6-c8b6-455b-964d-e289b98fc94b tempest-VolumeDependencyTests-884659083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.20d9d097-bfb0-4c91-baa1-037cea23edfc {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:53 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.20d9d097-bfb0-4c91-baa1-037cea23edfc Sep 05 05:10:53 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:53 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bd91dfb6-c8b6-455b-964d-e289b98fc94b tempest-VolumeDependencyTests-884659083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.20d9d097-bfb0-4c91-baa1-037cea23edfc" returned: 0 in 0.430s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bd91dfb6-c8b6-455b-964d-e289b98fc94b tempest-VolumeDependencyTests-884659083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:53 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.info Sep 05 05:10:53 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:53 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bd91dfb6-c8b6-455b-964d-e289b98fc94b tempest-VolumeDependencyTests-884659083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.info" returned: 0 in 0.316s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:53 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-bd91dfb6-c8b6-455b-964d-e289b98fc94b tempest-VolumeDependencyTests-884659083 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.info is being set with open permissions: ugo+rw Sep 05 05:10:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bd91dfb6-c8b6-455b-964d-e289b98fc94b tempest-VolumeDependencyTests-884659083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:53 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.info Sep 05 05:10:53 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:54 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bd91dfb6-c8b6-455b-964d-e289b98fc94b tempest-VolumeDependencyTests-884659083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.info" returned: 0 in 0.303s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-bd91dfb6-c8b6-455b-964d-e289b98fc94b tempest-VolumeDependencyTests-884659083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.774s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-aa9cb3fe-d977-4a44-92d0-c93508cbcaab tempest-VolumesExtendTest-343820221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.449s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-aa9cb3fe-d977-4a44-92d0-c93508cbcaab tempest-VolumesExtendTest-343820221 None] Creating offline snapshot 0291f8e8-7254-49e9-9612-3c102462662b of volume 5475cb34-bcbe-49d3-8b48-2e7fae4455b0 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:10:54 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-bd91dfb6-c8b6-455b-964d-e289b98fc94b tempest-VolumeDependencyTests-884659083 None] Create snapshot completed successfully Sep 05 05:10:54 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b6d954-a615-42e1-a3dd-7044ed3b9c88]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa9cb3fe-d977-4a44-92d0-c93508cbcaab tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:54 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0 Sep 05 05:10:54 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:54 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa9cb3fe-d977-4a44-92d0-c93508cbcaab tempest-VolumesExtendTest-343820221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0" returned: 0 in 0.541s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa9cb3fe-d977-4a44-92d0-c93508cbcaab tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.0291f8e8-7254-49e9-9612-3c102462662b 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:54 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.0291f8e8-7254-49e9-9612-3c102462662b 1G Sep 05 05:10:54 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:55 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:10:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Flow 'volume_create_manager' (b380d26e-f0a7-4bb4-a738-4ba0c828d7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:10:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e82a36-3b3e-4b86-996e-1c45e4f1a2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e82a36-3b3e-4b86-996e-1c45e4f1a2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-727120198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce2c2711-5f6a-4ad8-9e9a-695206284a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9d54fd8d148404a9682b867d09a5055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=20d9d097-bfb0-4c91-baa1-037cea23edfc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:10:55Z,use_quota=True,user_id='5a25fea45bb345cb829e344c6ea16b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc2af78-a6f8-41b1-8afe-218b45fc4215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc2af78-a6f8-41b1-8afe-218b45fc4215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1c0f81-8106-404a-a47c-bec2a9a7b373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1c0f81-8106-404a-a47c-bec2a9a7b373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ce2c2711-5f6a-4ad8-9e9a-695206284a70', 'volume_name': 'volume-ce2c2711-5f6a-4ad8-9e9a-695206284a70', 'volume_size': 1, 'snapshot_id': '20d9d097-bfb0-4c91-baa1-037cea23edfc'}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d04050d-c786-4aa9-a751-5d41ed7a5c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d04050d-c786-4aa9-a751-5d41ed7a5c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:10:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6125e406-54f9-4f34-9167-55f5770e67a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:10:55 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Volume ce2c2711-5f6a-4ad8-9e9a-695206284a70: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ce2c2711-5f6a-4ad8-9e9a-695206284a70', 'volume_size': 1, 'snapshot_id': '20d9d097-bfb0-4c91-baa1-037cea23edfc'} Sep 05 05:10:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:55 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa9cb3fe-d977-4a44-92d0-c93508cbcaab tempest-VolumesExtendTest-343820221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.0291f8e8-7254-49e9-9612-3c102462662b 1G" returned: 0 in 0.881s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa9cb3fe-d977-4a44-92d0-c93508cbcaab tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.0291f8e8-7254-49e9-9612-3c102462662b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:55 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.0291f8e8-7254-49e9-9612-3c102462662b Sep 05 05:10:55 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:55 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa9cb3fe-d977-4a44-92d0-c93508cbcaab tempest-VolumesExtendTest-343820221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.0291f8e8-7254-49e9-9612-3c102462662b" returned: 0 in 0.336s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:55 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-aa9cb3fe-d977-4a44-92d0-c93508cbcaab tempest-VolumesExtendTest-343820221 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.0291f8e8-7254-49e9-9612-3c102462662b is being set with open permissions: ugo+rw Sep 05 05:10:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa9cb3fe-d977-4a44-92d0-c93508cbcaab tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.0291f8e8-7254-49e9-9612-3c102462662b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:56 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.0291f8e8-7254-49e9-9612-3c102462662b Sep 05 05:10:56 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:56 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa9cb3fe-d977-4a44-92d0-c93508cbcaab tempest-VolumesExtendTest-343820221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.0291f8e8-7254-49e9-9612-3c102462662b" returned: 0 in 0.298s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa9cb3fe-d977-4a44-92d0-c93508cbcaab tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:56 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.info Sep 05 05:10:56 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:56 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa9cb3fe-d977-4a44-92d0-c93508cbcaab tempest-VolumesExtendTest-343820221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.info" returned: 0 in 0.308s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:56 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-aa9cb3fe-d977-4a44-92d0-c93508cbcaab tempest-VolumesExtendTest-343820221 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.info is being set with open permissions: ugo+rw Sep 05 05:10:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa9cb3fe-d977-4a44-92d0-c93508cbcaab tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:56 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.info Sep 05 05:10:56 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:56 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa9cb3fe-d977-4a44-92d0-c93508cbcaab tempest-VolumesExtendTest-343820221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.info" returned: 0 in 0.299s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-aa9cb3fe-d977-4a44-92d0-c93508cbcaab tempest-VolumesExtendTest-343820221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.826s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.410s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Acquiring lock "cinder-quobyte-20d9d097-bfb0-4c91-baa1-037cea23edfc-ce2c2711-5f6a-4ad8-9e9a-695206284a70" by "_create_volume_from_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Lock "cinder-quobyte-20d9d097-bfb0-4c91-baa1-037cea23edfc-ce2c2711-5f6a-4ad8-9e9a-695206284a70" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Creating volume ce2c2711-5f6a-4ad8-9e9a-695206284a70 from snapshot 20d9d097-bfb0-4c91-baa1-037cea23edfc {{(pid=89331) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 05:10:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:10:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Acquiring lock "cinder-quobyte-ce2c2711-5f6a-4ad8-9e9a-695206284a70" by "_copy_volume_from_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:10:57 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-aa9cb3fe-d977-4a44-92d0-c93508cbcaab tempest-VolumesExtendTest-343820221 None] Create snapshot completed successfully Sep 05 05:10:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Lock "cinder-quobyte-ce2c2711-5f6a-4ad8-9e9a-695206284a70" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:10:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] snapshot: 20d9d097-bfb0-4c91-baa1-037cea23edfc, volume: ce2c2711-5f6a-4ad8-9e9a-695206284a70, {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 05:10:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:10:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:10:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:10:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:10:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:10:57 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7361ab03-4719-4b25-a4bd-54ab256b4f87]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.20d9d097-bfb0-4c91-baa1-037cea23edfc {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:57 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.20d9d097-bfb0-4c91-baa1-037cea23edfc Sep 05 05:10:57 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:57 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.20d9d097-bfb0-4c91-baa1-037cea23edfc" returned: 0 in 0.445s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:10:57 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b233a208-2c88-4310-a1a6-be7c59bdd6bf]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:10:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:57 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0 Sep 05 05:10:57 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:58 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Sep 05 05:10:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0" returned: 0 in 0.575s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:10:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0 {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 05:10:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Creating direct copy from snapshot {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 05:10:58 devstack cinder-volume[89331]: DEBUG cinder.utils [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Path /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ce2c2711-5f6a-4ad8-9e9a-695206284a70 not found in is_blk_device check {{(pid=89331) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 05:10:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ce2c2711-5f6a-4ad8-9e9a-695206284a70 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:10:58 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ce2c2711-5f6a-4ad8-9e9a-695206284a70 Sep 05 05:10:58 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:10:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-464d0e43-0d84-44e8-a7f2-1647aa1c9cb4 tempest-VolumesExtendTest-343820221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:11:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ad4e12d7-bbd2-4f6e-aff7-4b7f968be0ec tempest-VolumesActionsTest-1530445118 None] Acquiring lock "cinder-39594f6f-d41b-4554-92a6-0fab8b4f7d3f" by "attach_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ad4e12d7-bbd2-4f6e-aff7-4b7f968be0ec tempest-VolumesActionsTest-1530445118 None] Lock "cinder-39594f6f-d41b-4554-92a6-0fab8b4f7d3f" acquired by "attach_volume" :: waited 0.062s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:03 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ad4e12d7-bbd2-4f6e-aff7-4b7f968be0ec tempest-VolumesActionsTest-1530445118 None] Attaching volume 39594f6f-d41b-4554-92a6-0fab8b4f7d3f to instance 292462c5-87e2-47c8-a8c3-436184095ad9 at mountpoint /dev/vdb on host None. Sep 05 05:11:03 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ad4e12d7-bbd2-4f6e-aff7-4b7f968be0ec tempest-VolumesActionsTest-1530445118 None] Attach volume completed successfully. Sep 05 05:11:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ad4e12d7-bbd2-4f6e-aff7-4b7f968be0ec tempest-VolumesActionsTest-1530445118 None] Lock "cinder-39594f6f-d41b-4554-92a6-0fab8b4f7d3f" released by "attach_volume" :: held 0.219s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3b80b482-a2e7-4e88-80f1-ece46989f533 tempest-VolumesActionsTest-1530445118 None] Acquiring lock "cinder-39594f6f-d41b-4554-92a6-0fab8b4f7d3f-detach_volume" by "detach_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3b80b482-a2e7-4e88-80f1-ece46989f533 tempest-VolumesActionsTest-1530445118 None] Lock "cinder-39594f6f-d41b-4554-92a6-0fab8b4f7d3f-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:04 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-3b80b482-a2e7-4e88-80f1-ece46989f533 tempest-VolumesActionsTest-1530445118 None] Detaching volume 39594f6f-d41b-4554-92a6-0fab8b4f7d3f from instance 292462c5-87e2-47c8-a8c3-436184095ad9. Sep 05 05:11:04 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-3b80b482-a2e7-4e88-80f1-ece46989f533 tempest-VolumesActionsTest-1530445118 None] Detach volume completed successfully. Sep 05 05:11:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3b80b482-a2e7-4e88-80f1-ece46989f533 tempest-VolumesActionsTest-1530445118 None] Lock "cinder-39594f6f-d41b-4554-92a6-0fab8b4f7d3f-detach_volume" released by "detach_volume" :: held 0.167s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ce2c2711-5f6a-4ad8-9e9a-695206284a70" returned: 0 in 7.797s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:05 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0, size 1024.00 MB, duration 7.80 sec, destination /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ce2c2711-5f6a-4ad8-9e9a-695206284a70 {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:11:05 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Converted 1024.00 MB image at 131.31 MB/s Sep 05 05:11:05 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ce2c2711-5f6a-4ad8-9e9a-695206284a70 is being set with open permissions: ugo+rw Sep 05 05:11:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ce2c2711-5f6a-4ad8-9e9a-695206284a70 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:06 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ce2c2711-5f6a-4ad8-9e9a-695206284a70 Sep 05 05:11:06 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:06 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ce2c2711-5f6a-4ad8-9e9a-695206284a70" returned: 0 in 0.373s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Lock "cinder-quobyte-ce2c2711-5f6a-4ad8-9e9a-695206284a70" released by "_copy_volume_from_snapshot" :: held 9.304s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Lock "cinder-quobyte-20d9d097-bfb0-4c91-baa1-037cea23edfc-ce2c2711-5f6a-4ad8-9e9a-695206284a70" released by "_create_volume_from_snapshot" :: held 9.418s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.462s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:11:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-464d0e43-0d84-44e8-a7f2-1647aa1c9cb4 tempest-VolumesExtendTest-343820221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 7.993s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:11:06 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21469b5-0fc1-4532-882c-def1a58ed494]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:11:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-464d0e43-0d84-44e8-a7f2-1647aa1c9cb4 tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6125e406-54f9-4f34-9167-55f5770e67a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce2c2711-5f6a-4ad8-9e9a-695206284a70', 'volume_size': 1, 'snapshot_id': '20d9d097-bfb0-4c91-baa1-037cea23edfc'}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112881f9-23e1-45ed-96ad-06a65038c0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:06 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Volume volume-ce2c2711-5f6a-4ad8-9e9a-695206284a70 (ce2c2711-5f6a-4ad8-9e9a-695206284a70): created successfully Sep 05 05:11:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112881f9-23e1-45ed-96ad-06a65038c0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Flow 'volume_create_manager' (b380d26e-f0a7-4bb4-a738-4ba0c828d7bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:11:06 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-c931c49b-a07d-47af-87ef-028e26785754 tempest-VolumeDependencyTests-884659083 None] Created volume successfully. Sep 05 05:11:06 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0 Sep 05 05:11:06 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:06 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-464d0e43-0d84-44e8-a7f2-1647aa1c9cb4 tempest-VolumesExtendTest-343820221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0" returned: 0 in 0.459s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-464d0e43-0d84-44e8-a7f2-1647aa1c9cb4 tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.0291f8e8-7254-49e9-9612-3c102462662b 2G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-464d0e43-0d84-44e8-a7f2-1647aa1c9cb4 tempest-VolumesExtendTest-343820221 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.0291f8e8-7254-49e9-9612-3c102462662b 2G" returned: 0 in 0.159s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-464d0e43-0d84-44e8-a7f2-1647aa1c9cb4 tempest-VolumesExtendTest-343820221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.694s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:11:07 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-464d0e43-0d84-44e8-a7f2-1647aa1c9cb4 tempest-VolumesExtendTest-343820221 None] Extend volume completed successfully. Sep 05 05:11:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-71e4c710-5c64-48ee-bfa3-9f33bfabb743 tempest-VolumeDependencyTests-884659083 None] Acquiring lock "cinder-20d9d097-bfb0-4c91-baa1-037cea23edfc-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-71e4c710-5c64-48ee-bfa3-9f33bfabb743 tempest-VolumeDependencyTests-884659083 None] Lock "cinder-20d9d097-bfb0-4c91-baa1-037cea23edfc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-71e4c710-5c64-48ee-bfa3-9f33bfabb743 tempest-VolumeDependencyTests-884659083 None] Acquiring lock "cinder-quobyte-089c8a8b-07d5-44b8-9fa4-04b189665cb0" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-71e4c710-5c64-48ee-bfa3-9f33bfabb743 tempest-VolumeDependencyTests-884659083 None] Lock "cinder-quobyte-089c8a8b-07d5-44b8-9fa4-04b189665cb0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-71e4c710-5c64-48ee-bfa3-9f33bfabb743 tempest-VolumeDependencyTests-884659083 None] Acquiring lock "cinder-quobyte-20d9d097-bfb0-4c91-baa1-037cea23edfc" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-71e4c710-5c64-48ee-bfa3-9f33bfabb743 tempest-VolumeDependencyTests-884659083 None] Lock "cinder-quobyte-20d9d097-bfb0-4c91-baa1-037cea23edfc" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-71e4c710-5c64-48ee-bfa3-9f33bfabb743 tempest-VolumeDependencyTests-884659083 None] Deleting offline snapshot 20d9d097-bfb0-4c91-baa1-037cea23edfc of volume 089c8a8b-07d5-44b8-9fa4-04b189665cb0 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:11:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-71e4c710-5c64-48ee-bfa3-9f33bfabb743 tempest-VolumeDependencyTests-884659083 None] snapshot_file for this snap is: volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.20d9d097-bfb0-4c91-baa1-037cea23edfc {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:11:07 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[21166782-5788-405d-928e-4eaa4b29a346]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:11:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-71e4c710-5c64-48ee-bfa3-9f33bfabb743 tempest-VolumeDependencyTests-884659083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.20d9d097-bfb0-4c91-baa1-037cea23edfc {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:07 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.20d9d097-bfb0-4c91-baa1-037cea23edfc Sep 05 05:11:07 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:07 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-71e4c710-5c64-48ee-bfa3-9f33bfabb743 tempest-VolumeDependencyTests-884659083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.20d9d097-bfb0-4c91-baa1-037cea23edfc" returned: 0 in 0.412s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-71e4c710-5c64-48ee-bfa3-9f33bfabb743 tempest-VolumeDependencyTests-884659083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:11:07 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7938785-dd86-43f6-a435-f7ac3fe0b577]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:11:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-71e4c710-5c64-48ee-bfa3-9f33bfabb743 tempest-VolumeDependencyTests-884659083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:08 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0 Sep 05 05:11:08 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-124c3d05-4266-40f3-9f70-7a9cf23a1ff8 tempest-VolumesExtendTest-343820221 None] Acquiring lock "cinder-0291f8e8-7254-49e9-9612-3c102462662b-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-124c3d05-4266-40f3-9f70-7a9cf23a1ff8 tempest-VolumesExtendTest-343820221 None] Lock "cinder-0291f8e8-7254-49e9-9612-3c102462662b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-124c3d05-4266-40f3-9f70-7a9cf23a1ff8 tempest-VolumesExtendTest-343820221 None] Acquiring lock "cinder-quobyte-5475cb34-bcbe-49d3-8b48-2e7fae4455b0" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-124c3d05-4266-40f3-9f70-7a9cf23a1ff8 tempest-VolumesExtendTest-343820221 None] Lock "cinder-quobyte-5475cb34-bcbe-49d3-8b48-2e7fae4455b0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-124c3d05-4266-40f3-9f70-7a9cf23a1ff8 tempest-VolumesExtendTest-343820221 None] Acquiring lock "cinder-quobyte-0291f8e8-7254-49e9-9612-3c102462662b" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-124c3d05-4266-40f3-9f70-7a9cf23a1ff8 tempest-VolumesExtendTest-343820221 None] Lock "cinder-quobyte-0291f8e8-7254-49e9-9612-3c102462662b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-124c3d05-4266-40f3-9f70-7a9cf23a1ff8 tempest-VolumesExtendTest-343820221 None] Deleting offline snapshot 0291f8e8-7254-49e9-9612-3c102462662b of volume 5475cb34-bcbe-49d3-8b48-2e7fae4455b0 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:11:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-124c3d05-4266-40f3-9f70-7a9cf23a1ff8 tempest-VolumesExtendTest-343820221 None] snapshot_file for this snap is: volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.0291f8e8-7254-49e9-9612-3c102462662b {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:11:08 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e688c73-4b0f-4e4d-aaca-367c32358576]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:11:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-124c3d05-4266-40f3-9f70-7a9cf23a1ff8 tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.0291f8e8-7254-49e9-9612-3c102462662b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:08 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.0291f8e8-7254-49e9-9612-3c102462662b Sep 05 05:11:08 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:08 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-71e4c710-5c64-48ee-bfa3-9f33bfabb743 tempest-VolumeDependencyTests-884659083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0" returned: 0 in 0.605s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-71e4c710-5c64-48ee-bfa3-9f33bfabb743 tempest-VolumeDependencyTests-884659083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.20d9d097-bfb0-4c91-baa1-037cea23edfc {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:08 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.20d9d097-bfb0-4c91-baa1-037cea23edfc Sep 05 05:11:08 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:08 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-124c3d05-4266-40f3-9f70-7a9cf23a1ff8 tempest-VolumesExtendTest-343820221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.0291f8e8-7254-49e9-9612-3c102462662b" returned: 0 in 0.398s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-124c3d05-4266-40f3-9f70-7a9cf23a1ff8 tempest-VolumesExtendTest-343820221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:11:08 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8221890b-6e9d-46c2-9dea-01e5f9e7a3fc]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:11:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-124c3d05-4266-40f3-9f70-7a9cf23a1ff8 tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:08 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-71e4c710-5c64-48ee-bfa3-9f33bfabb743 tempest-VolumeDependencyTests-884659083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.20d9d097-bfb0-4c91-baa1-037cea23edfc" returned: 0 in 0.354s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-71e4c710-5c64-48ee-bfa3-9f33bfabb743 tempest-VolumeDependencyTests-884659083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.20d9d097-bfb0-4c91-baa1-037cea23edfc {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:08 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0 Sep 05 05:11:08 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:08 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.20d9d097-bfb0-4c91-baa1-037cea23edfc Sep 05 05:11:08 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:09 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-71e4c710-5c64-48ee-bfa3-9f33bfabb743 tempest-VolumeDependencyTests-884659083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0.20d9d097-bfb0-4c91-baa1-037cea23edfc" returned: 0 in 0.405s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-71e4c710-5c64-48ee-bfa3-9f33bfabb743 tempest-VolumeDependencyTests-884659083 None] Lock "cinder-quobyte-20d9d097-bfb0-4c91-baa1-037cea23edfc" released by "_delete_snapshot" :: held 1.928s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-71e4c710-5c64-48ee-bfa3-9f33bfabb743 tempest-VolumeDependencyTests-884659083 None] Lock "cinder-quobyte-089c8a8b-07d5-44b8-9fa4-04b189665cb0" released by "delete_snapshot" :: held 1.965s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:09 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-124c3d05-4266-40f3-9f70-7a9cf23a1ff8 tempest-VolumesExtendTest-343820221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0" returned: 0 in 0.667s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-124c3d05-4266-40f3-9f70-7a9cf23a1ff8 tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.0291f8e8-7254-49e9-9612-3c102462662b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:09 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-71e4c710-5c64-48ee-bfa3-9f33bfabb743 tempest-VolumeDependencyTests-884659083 None] Created reservations ['b0d5c568-e3af-4e90-82f9-f0a55c0b77ba', 'e54ce677-b0d1-4d9d-9f4d-9806015af2f0', 'b7144408-81df-46cc-b587-66282c5b0c1a', 'ecf04d1c-4df1-4434-bbac-64c93d8833e8'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:11:09 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.0291f8e8-7254-49e9-9612-3c102462662b Sep 05 05:11:09 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:09 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-71e4c710-5c64-48ee-bfa3-9f33bfabb743 tempest-VolumeDependencyTests-884659083 None] Delete snapshot completed successfully. Sep 05 05:11:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-71e4c710-5c64-48ee-bfa3-9f33bfabb743 tempest-VolumeDependencyTests-884659083 None] Lock "cinder-20d9d097-bfb0-4c91-baa1-037cea23edfc-delete_snapshot" released by "delete_snapshot" :: held 2.176s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:09 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-124c3d05-4266-40f3-9f70-7a9cf23a1ff8 tempest-VolumesExtendTest-343820221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.0291f8e8-7254-49e9-9612-3c102462662b" returned: 0 in 0.471s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-124c3d05-4266-40f3-9f70-7a9cf23a1ff8 tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.0291f8e8-7254-49e9-9612-3c102462662b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:09 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.0291f8e8-7254-49e9-9612-3c102462662b Sep 05 05:11:09 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:10 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-124c3d05-4266-40f3-9f70-7a9cf23a1ff8 tempest-VolumesExtendTest-343820221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0.0291f8e8-7254-49e9-9612-3c102462662b" returned: 0 in 0.245s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-124c3d05-4266-40f3-9f70-7a9cf23a1ff8 tempest-VolumesExtendTest-343820221 None] Lock "cinder-quobyte-0291f8e8-7254-49e9-9612-3c102462662b" released by "_delete_snapshot" :: held 1.925s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-124c3d05-4266-40f3-9f70-7a9cf23a1ff8 tempest-VolumesExtendTest-343820221 None] Lock "cinder-quobyte-5475cb34-bcbe-49d3-8b48-2e7fae4455b0" released by "delete_snapshot" :: held 1.957s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:10 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-124c3d05-4266-40f3-9f70-7a9cf23a1ff8 tempest-VolumesExtendTest-343820221 None] Created reservations ['b09b0847-d36e-4a6a-b110-67adbb0b8b4f', '5423b9d7-7504-471f-86d7-973f2523f57b', '634fd736-722d-45fa-9b57-acaa9f8a3148', '68551765-0558-4f76-89da-974019dbe771'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:11:10 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-124c3d05-4266-40f3-9f70-7a9cf23a1ff8 tempest-VolumesExtendTest-343820221 None] Delete snapshot completed successfully. Sep 05 05:11:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-124c3d05-4266-40f3-9f70-7a9cf23a1ff8 tempest-VolumesExtendTest-343820221 None] Lock "cinder-0291f8e8-7254-49e9-9612-3c102462662b-delete_snapshot" released by "delete_snapshot" :: held 2.147s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-352a60c2-d18a-41ee-9b7c-fbf13e4749fb tempest-VolumesExtendTest-343820221 None] Acquiring lock "cinder-5475cb34-bcbe-49d3-8b48-2e7fae4455b0-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-352a60c2-d18a-41ee-9b7c-fbf13e4749fb tempest-VolumesExtendTest-343820221 None] Lock "cinder-5475cb34-bcbe-49d3-8b48-2e7fae4455b0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-352a60c2-d18a-41ee-9b7c-fbf13e4749fb tempest-VolumesExtendTest-343820221 None] Acquiring lock "cinder-quobyte-5475cb34-bcbe-49d3-8b48-2e7fae4455b0" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-887d0a61-4d85-46d4-ae49-898481e7c3cc tempest-VolumeDependencyTests-884659083 None] Acquiring lock "cinder-089c8a8b-07d5-44b8-9fa4-04b189665cb0-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-352a60c2-d18a-41ee-9b7c-fbf13e4749fb tempest-VolumesExtendTest-343820221 None] Lock "cinder-quobyte-5475cb34-bcbe-49d3-8b48-2e7fae4455b0" acquired by "delete_volume" :: waited 0.041s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-887d0a61-4d85-46d4-ae49-898481e7c3cc tempest-VolumeDependencyTests-884659083 None] Lock "cinder-089c8a8b-07d5-44b8-9fa4-04b189665cb0-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:10 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[50602cd3-48d8-4d0a-a966-f760d0be7cf3]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:11:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-352a60c2-d18a-41ee-9b7c-fbf13e4749fb tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-887d0a61-4d85-46d4-ae49-898481e7c3cc tempest-VolumeDependencyTests-884659083 None] Acquiring lock "cinder-quobyte-089c8a8b-07d5-44b8-9fa4-04b189665cb0" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-887d0a61-4d85-46d4-ae49-898481e7c3cc tempest-VolumeDependencyTests-884659083 None] Lock "cinder-quobyte-089c8a8b-07d5-44b8-9fa4-04b189665cb0" acquired by "delete_volume" :: waited 0.022s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:10 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b095acc-445c-4a23-9ac0-5e65f92047fa]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:11:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-887d0a61-4d85-46d4-ae49-898481e7c3cc tempest-VolumeDependencyTests-884659083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:10 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0 Sep 05 05:11:10 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:11 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0 Sep 05 05:11:11 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:11 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-352a60c2-d18a-41ee-9b7c-fbf13e4749fb tempest-VolumesExtendTest-343820221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0" returned: 0 in 0.456s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-352a60c2-d18a-41ee-9b7c-fbf13e4749fb tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:11 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0 Sep 05 05:11:11 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:11 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-887d0a61-4d85-46d4-ae49-898481e7c3cc tempest-VolumeDependencyTests-884659083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0" returned: 0 in 0.575s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-887d0a61-4d85-46d4-ae49-898481e7c3cc tempest-VolumeDependencyTests-884659083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:11 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0 Sep 05 05:11:11 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:11 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-352a60c2-d18a-41ee-9b7c-fbf13e4749fb tempest-VolumesExtendTest-343820221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5475cb34-bcbe-49d3-8b48-2e7fae4455b0" returned: 0 in 0.340s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-352a60c2-d18a-41ee-9b7c-fbf13e4749fb tempest-VolumesExtendTest-343820221 None] Lock "cinder-quobyte-5475cb34-bcbe-49d3-8b48-2e7fae4455b0" released by "delete_volume" :: held 0.932s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:11 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-352a60c2-d18a-41ee-9b7c-fbf13e4749fb tempest-VolumesExtendTest-343820221 None] Created reservations ['5381d3af-fbfb-41c2-a9e9-80d914cadcd5', '3937583d-8369-437e-a4b4-986fe3d22c71', '268258f1-3371-4119-a285-31a7a91bb58f', '2724b0aa-c3ee-4709-b27f-5725b774b53f'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:11:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-352a60c2-d18a-41ee-9b7c-fbf13e4749fb tempest-VolumesExtendTest-343820221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:11:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-352a60c2-d18a-41ee-9b7c-fbf13e4749fb tempest-VolumesExtendTest-343820221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:11:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-352a60c2-d18a-41ee-9b7c-fbf13e4749fb tempest-VolumesExtendTest-343820221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:11:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-352a60c2-d18a-41ee-9b7c-fbf13e4749fb tempest-VolumesExtendTest-343820221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:11:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-352a60c2-d18a-41ee-9b7c-fbf13e4749fb tempest-VolumesExtendTest-343820221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:11:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-352a60c2-d18a-41ee-9b7c-fbf13e4749fb tempest-VolumesExtendTest-343820221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:11 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:11:11 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:12 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-887d0a61-4d85-46d4-ae49-898481e7c3cc tempest-VolumeDependencyTests-884659083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-089c8a8b-07d5-44b8-9fa4-04b189665cb0" returned: 0 in 0.563s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-887d0a61-4d85-46d4-ae49-898481e7c3cc tempest-VolumeDependencyTests-884659083 None] Lock "cinder-quobyte-089c8a8b-07d5-44b8-9fa4-04b189665cb0" released by "delete_volume" :: held 1.234s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:12 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-887d0a61-4d85-46d4-ae49-898481e7c3cc tempest-VolumeDependencyTests-884659083 None] Created reservations ['82c2cd58-8503-49d8-9b8c-cd35f5488afd', '9725215d-8e4d-40d8-8ae3-bc0fb533389a', 'a53c900a-a2af-4994-91ef-97503173679d', '9681f2d2-8297-4198-88cc-f0488d3e1f4b'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:11:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-887d0a61-4d85-46d4-ae49-898481e7c3cc tempest-VolumeDependencyTests-884659083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:11:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-887d0a61-4d85-46d4-ae49-898481e7c3cc tempest-VolumeDependencyTests-884659083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:11:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-887d0a61-4d85-46d4-ae49-898481e7c3cc tempest-VolumeDependencyTests-884659083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:11:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-887d0a61-4d85-46d4-ae49-898481e7c3cc tempest-VolumeDependencyTests-884659083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:11:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-887d0a61-4d85-46d4-ae49-898481e7c3cc tempest-VolumeDependencyTests-884659083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:11:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-887d0a61-4d85-46d4-ae49-898481e7c3cc tempest-VolumeDependencyTests-884659083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:12 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-352a60c2-d18a-41ee-9b7c-fbf13e4749fb tempest-VolumesExtendTest-343820221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.443s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:12 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-352a60c2-d18a-41ee-9b7c-fbf13e4749fb tempest-VolumesExtendTest-343820221 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:11:12 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-352a60c2-d18a-41ee-9b7c-fbf13e4749fb tempest-VolumesExtendTest-343820221 None] Deleted volume successfully. Sep 05 05:11:12 devstack sudo[99969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:11:12 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-352a60c2-d18a-41ee-9b7c-fbf13e4749fb tempest-VolumesExtendTest-343820221 None] Lock "cinder-5475cb34-bcbe-49d3-8b48-2e7fae4455b0-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:12 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-887d0a61-4d85-46d4-ae49-898481e7c3cc tempest-VolumeDependencyTests-884659083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.370s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:12 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-887d0a61-4d85-46d4-ae49-898481e7c3cc tempest-VolumeDependencyTests-884659083 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:11:12 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-887d0a61-4d85-46d4-ae49-898481e7c3cc tempest-VolumeDependencyTests-884659083 None] Deleted volume successfully. Sep 05 05:11:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-887d0a61-4d85-46d4-ae49-898481e7c3cc tempest-VolumeDependencyTests-884659083 None] Lock "cinder-089c8a8b-07d5-44b8-9fa4-04b189665cb0-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:13 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-179191fb-f3b6-416b-9664-9dd39d3b8669 tempest-VolumeDependencyTests-884659083 None] Acquiring lock "cinder-ce2c2711-5f6a-4ad8-9e9a-695206284a70-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:13 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-179191fb-f3b6-416b-9664-9dd39d3b8669 tempest-VolumeDependencyTests-884659083 None] Lock "cinder-ce2c2711-5f6a-4ad8-9e9a-695206284a70-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:13 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-179191fb-f3b6-416b-9664-9dd39d3b8669 tempest-VolumeDependencyTests-884659083 None] Acquiring lock "cinder-quobyte-ce2c2711-5f6a-4ad8-9e9a-695206284a70" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:13 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-179191fb-f3b6-416b-9664-9dd39d3b8669 tempest-VolumeDependencyTests-884659083 None] Lock "cinder-quobyte-ce2c2711-5f6a-4ad8-9e9a-695206284a70" acquired by "delete_volume" :: waited 0.039s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:13 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6969fa-1745-4fd3-9c73-fe7b8df6d99c]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:11:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-179191fb-f3b6-416b-9664-9dd39d3b8669 tempest-VolumeDependencyTests-884659083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ce2c2711-5f6a-4ad8-9e9a-695206284a70 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:13 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ce2c2711-5f6a-4ad8-9e9a-695206284a70 Sep 05 05:11:13 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:13 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-179191fb-f3b6-416b-9664-9dd39d3b8669 tempest-VolumeDependencyTests-884659083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ce2c2711-5f6a-4ad8-9e9a-695206284a70" returned: 0 in 0.509s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-179191fb-f3b6-416b-9664-9dd39d3b8669 tempest-VolumeDependencyTests-884659083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ce2c2711-5f6a-4ad8-9e9a-695206284a70 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:13 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ce2c2711-5f6a-4ad8-9e9a-695206284a70 Sep 05 05:11:13 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:14 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-179191fb-f3b6-416b-9664-9dd39d3b8669 tempest-VolumeDependencyTests-884659083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ce2c2711-5f6a-4ad8-9e9a-695206284a70" returned: 0 in 0.329s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:14 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-179191fb-f3b6-416b-9664-9dd39d3b8669 tempest-VolumeDependencyTests-884659083 None] Lock "cinder-quobyte-ce2c2711-5f6a-4ad8-9e9a-695206284a70" released by "delete_volume" :: held 0.910s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:14 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-179191fb-f3b6-416b-9664-9dd39d3b8669 tempest-VolumeDependencyTests-884659083 None] Created reservations ['1b539413-c695-4f39-a3fa-85c4d79dcd61', '3a879d31-d8a3-4572-be34-f09092ab9d2c', '2e9c3da3-662d-47bc-9225-13c2bf81716a', '386701a9-2d0e-4823-bfa8-58ce25fa32ef'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:11:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-179191fb-f3b6-416b-9664-9dd39d3b8669 tempest-VolumeDependencyTests-884659083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:11:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-179191fb-f3b6-416b-9664-9dd39d3b8669 tempest-VolumeDependencyTests-884659083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:11:14 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-179191fb-f3b6-416b-9664-9dd39d3b8669 tempest-VolumeDependencyTests-884659083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:11:14 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-179191fb-f3b6-416b-9664-9dd39d3b8669 tempest-VolumeDependencyTests-884659083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:11:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-179191fb-f3b6-416b-9664-9dd39d3b8669 tempest-VolumeDependencyTests-884659083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:11:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-179191fb-f3b6-416b-9664-9dd39d3b8669 tempest-VolumeDependencyTests-884659083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:14 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:11:14 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:14 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-179191fb-f3b6-416b-9664-9dd39d3b8669 tempest-VolumeDependencyTests-884659083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.337s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:14 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-179191fb-f3b6-416b-9664-9dd39d3b8669 tempest-VolumeDependencyTests-884659083 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:11:14 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-179191fb-f3b6-416b-9664-9dd39d3b8669 tempest-VolumeDependencyTests-884659083 None] Deleted volume successfully. Sep 05 05:11:14 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-179191fb-f3b6-416b-9664-9dd39d3b8669 tempest-VolumeDependencyTests-884659083 None] Lock "cinder-ce2c2711-5f6a-4ad8-9e9a-695206284a70-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:20 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-eb28b056-4d42-4a37-825c-db505a16ff11 tempest-VolumesActionsTest-1530445118 None] Acquiring lock "cinder-39594f6f-d41b-4554-92a6-0fab8b4f7d3f" by "attach_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:20 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:11:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Flow 'volume_create_manager' (e5a54477-4840-4556-8d71-b799f55ea592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f882928f-abcb-4a11-b9c9-6ef0f47e8ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-eb28b056-4d42-4a37-825c-db505a16ff11 tempest-VolumesActionsTest-1530445118 None] Lock "cinder-39594f6f-d41b-4554-92a6-0fab8b4f7d3f" acquired by "attach_volume" :: waited 0.092s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f882928f-abcb-4a11-b9c9-6ef0f47e8ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1833070272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a232609-7f15-4b85-934f-bfcb863f2600,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1622d954c6124a8d880f3c01fcedae40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:11:21Z,use_quota=True,user_id='e30ac61b08ca4e30bea1cc8509fa4adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8eedb03-57b5-4468-9cca-dfacec8e1ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8eedb03-57b5-4468-9cca-dfacec8e1ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b405b239-3981-4cc5-8bd4-fbd53e7e8289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b405b239-3981-4cc5-8bd4-fbd53e7e8289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a232609-7f15-4b85-934f-bfcb863f2600', 'volume_name': 'volume-9a232609-7f15-4b85-934f-bfcb863f2600', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95846b86-81bc-49b7-a3ce-5886069864f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95846b86-81bc-49b7-a3ce-5886069864f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb9214d-047a-4547-8295-9068a6b2ca3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:21 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Volume 9a232609-7f15-4b85-934f-bfcb863f2600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a232609-7f15-4b85-934f-bfcb863f2600', 'volume_size': 1} Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1833070272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a232609-7f15-4b85-934f-bfcb863f2600,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1622d954c6124a8d880f3c01fcedae40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:11:21Z,use_quota=True,user_id='e30ac61b08ca4e30bea1cc8509fa4adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Creating volume 9a232609-7f15-4b85-934f-bfcb863f2600 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:11:21 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9a232609-7f15-4b85-934f-bfcb863f2600 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:21 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9a232609-7f15-4b85-934f-bfcb863f2600 1073741824 Sep 05 05:11:21 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:21 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-eb28b056-4d42-4a37-825c-db505a16ff11 tempest-VolumesActionsTest-1530445118 None] Attaching volume 39594f6f-d41b-4554-92a6-0fab8b4f7d3f to instance 8211de1a-787c-44e1-b7f9-0b7e205ae174 at mountpoint /dev/vdb on host None. Sep 05 05:11:21 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-eb28b056-4d42-4a37-825c-db505a16ff11 tempest-VolumesActionsTest-1530445118 None] Attach volume completed successfully. Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-eb28b056-4d42-4a37-825c-db505a16ff11 tempest-VolumesActionsTest-1530445118 None] Lock "cinder-39594f6f-d41b-4554-92a6-0fab8b4f7d3f" released by "attach_volume" :: held 0.320s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9f7a472b-f0ec-4617-b4bf-ffdc1333c9de tempest-VolumesActionsTest-1530445118 None] Acquiring lock "cinder-39594f6f-d41b-4554-92a6-0fab8b4f7d3f-detach_volume" by "detach_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:21 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9a232609-7f15-4b85-934f-bfcb863f2600 1073741824" returned: 0 in 0.874s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:21 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9f7a472b-f0ec-4617-b4bf-ffdc1333c9de tempest-VolumesActionsTest-1530445118 None] Lock "cinder-39594f6f-d41b-4554-92a6-0fab8b4f7d3f-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:21 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-9f7a472b-f0ec-4617-b4bf-ffdc1333c9de tempest-VolumesActionsTest-1530445118 None] Detaching volume 39594f6f-d41b-4554-92a6-0fab8b4f7d3f from instance 8211de1a-787c-44e1-b7f9-0b7e205ae174. Sep 05 05:11:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9a232609-7f15-4b85-934f-bfcb863f2600 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:22 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-9f7a472b-f0ec-4617-b4bf-ffdc1333c9de tempest-VolumesActionsTest-1530445118 None] Detach volume completed successfully. Sep 05 05:11:22 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9a232609-7f15-4b85-934f-bfcb863f2600 Sep 05 05:11:22 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:22 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9f7a472b-f0ec-4617-b4bf-ffdc1333c9de tempest-VolumesActionsTest-1530445118 None] Lock "cinder-39594f6f-d41b-4554-92a6-0fab8b4f7d3f-detach_volume" released by "detach_volume" :: held 0.118s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:22 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9a232609-7f15-4b85-934f-bfcb863f2600" returned: 0 in 0.378s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:11:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:11:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb9214d-047a-4547-8295-9068a6b2ca3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a232609-7f15-4b85-934f-bfcb863f2600', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab04fdf-4659-426c-8567-b52f5e8c79a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:22 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Volume volume-9a232609-7f15-4b85-934f-bfcb863f2600 (9a232609-7f15-4b85-934f-bfcb863f2600): created successfully Sep 05 05:11:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab04fdf-4659-426c-8567-b52f5e8c79a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Flow 'volume_create_manager' (e5a54477-4840-4556-8d71-b799f55ea592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:11:22 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-d91a87f3-45af-4c56-b521-1de840e5b1e6 tempest-VolumesListTestJSON-67544199 None] Created volume successfully. Sep 05 05:11:23 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:11:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Flow 'volume_create_manager' (a109a72d-4e26-45d0-ae38-ae3d06eebd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:11:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef94c79a-767e-4a6f-935a-8f905519f996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef94c79a-767e-4a6f-935a-8f905519f996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1593974579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1127bb9e-6871-4a64-8890-cea7bdbe327b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1622d954c6124a8d880f3c01fcedae40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:11:24Z,use_quota=True,user_id='e30ac61b08ca4e30bea1cc8509fa4adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40439832-6db2-4ee1-b735-9d146de30565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40439832-6db2-4ee1-b735-9d146de30565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3051ee55-9e14-422f-9d74-738e84b3cb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3051ee55-9e14-422f-9d74-738e84b3cb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1127bb9e-6871-4a64-8890-cea7bdbe327b', 'volume_name': 'volume-1127bb9e-6871-4a64-8890-cea7bdbe327b', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ed04df9-f7c4-44bc-ad1c-fb6cf308743f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ed04df9-f7c4-44bc-ad1c-fb6cf308743f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33db2422-01b8-49a3-904b-bfd571d2df7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:23 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Volume 1127bb9e-6871-4a64-8890-cea7bdbe327b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1127bb9e-6871-4a64-8890-cea7bdbe327b', 'volume_size': 1} Sep 05 05:11:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:11:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:11:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1593974579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1127bb9e-6871-4a64-8890-cea7bdbe327b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1622d954c6124a8d880f3c01fcedae40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:11:24Z,use_quota=True,user_id='e30ac61b08ca4e30bea1cc8509fa4adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:11:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Creating volume 1127bb9e-6871-4a64-8890-cea7bdbe327b {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:11:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:11:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:11:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:11:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:11:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:11:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:11:23 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:11:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1127bb9e-6871-4a64-8890-cea7bdbe327b 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:24 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1127bb9e-6871-4a64-8890-cea7bdbe327b 1073741824 Sep 05 05:11:24 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:24 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1127bb9e-6871-4a64-8890-cea7bdbe327b 1073741824" returned: 0 in 0.817s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1127bb9e-6871-4a64-8890-cea7bdbe327b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:24 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1127bb9e-6871-4a64-8890-cea7bdbe327b Sep 05 05:11:24 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:25 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:11:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Flow 'volume_create_manager' (18a69137-f63b-41ef-8dc6-23585ac003ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:11:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4027158-89fa-424c-a6e3-a6facc3a6ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4027158-89fa-424c-a6e3-a6facc3a6ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa04cef7-354e-4dee-baf5-a8cfdbe74575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19aee8b72b354fdd8c000808c0a15f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:11:25Z,use_quota=True,user_id='b37b2260a3274aa09e29ddc2a1c1345e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba50e24-d742-4c95-8e17-669f745786b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba50e24-d742-4c95-8e17-669f745786b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eebaf7ea-7b92-46bf-99a6-0b3287f54f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:25 devstack cinder-volume[89331]: DEBUG cinder.image.glance [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Creating Keystone auth plugin from conf {{(pid=89331) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 05:11:25 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1127bb9e-6871-4a64-8890-cea7bdbe327b" returned: 0 in 0.371s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:11:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:11:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33db2422-01b8-49a3-904b-bfd571d2df7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1127bb9e-6871-4a64-8890-cea7bdbe327b', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6694b7-bce7-4e8d-bb23-ab4d01e3bee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:25 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Volume volume-1127bb9e-6871-4a64-8890-cea7bdbe327b (1127bb9e-6871-4a64-8890-cea7bdbe327b): created successfully Sep 05 05:11:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6694b7-bce7-4e8d-bb23-ab4d01e3bee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Flow 'volume_create_manager' (a109a72d-4e26-45d0-ae38-ae3d06eebd38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:11:25 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-05a098e2-0dba-4d6b-bc2d-32adcd419661 tempest-VolumesListTestJSON-67544199 None] Created volume successfully. Sep 05 05:11:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eebaf7ea-7b92-46bf-99a6-0b3287f54f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fa04cef7-354e-4dee-baf5-a8cfdbe74575', 'volume_name': 'volume-fa04cef7-354e-4dee-baf5-a8cfdbe74575', 'volume_size': 1, 'image_id': 'e8ca337a-b26f-442f-851b-9ec12741d511', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e8ca337a-b26f-442f-851b-9ec12741d511', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7b11baf0022158b3a30464a467e81107', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '19aee8b72b354fdd8c000808c0a15f05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd28a26a38de3d84863bcfd7b279053a156770d14d0265957cae9f6e2562dabe3e8dbd4f1325cd0b0d92ecee6cd5c225b73301ab396aec5acfc6ca503bee68bc8', 'id': 'e8ca337a-b26f-442f-851b-9ec12741d511', 'created_at': datetime.datetime(2026, 9, 5, 3, 11, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 3, 11, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e8ca337a-b26f-442f-851b-9ec12741d511/file', 'properties': {}}, 'image_service': }' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895f9bfb-e6b8-41cf-b0f7-2411ecdc97dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895f9bfb-e6b8-41cf-b0f7-2411ecdc97dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead9ea08-1b1f-4e7e-b54f-19d17a955aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:25 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Volume fa04cef7-354e-4dee-baf5-a8cfdbe74575: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fa04cef7-354e-4dee-baf5-a8cfdbe74575', 'volume_size': 1, 'image_id': 'e8ca337a-b26f-442f-851b-9ec12741d511', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e8ca337a-b26f-442f-851b-9ec12741d511', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7b11baf0022158b3a30464a467e81107', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '19aee8b72b354fdd8c000808c0a15f05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd28a26a38de3d84863bcfd7b279053a156770d14d0265957cae9f6e2562dabe3e8dbd4f1325cd0b0d92ecee6cd5c225b73301ab396aec5acfc6ca503bee68bc8', 'id': 'e8ca337a-b26f-442f-851b-9ec12741d511', 'created_at': datetime.datetime(2026, 9, 5, 3, 11, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 3, 11, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e8ca337a-b26f-442f-851b-9ec12741d511/file', 'properties': {}}, 'image_service': } Sep 05 05:11:25 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Trying to clone fa04cef7-354e-4dee-baf5-a8cfdbe74575 from image e8ca337a-b26f-442f-851b-9ec12741d511 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e8ca337a-b26f-442f-851b-9ec12741d511', 'metadata': {}}]). {{(pid=89331) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 05:11:25 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 05:11:25 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Image download 0.00 MB at 0.00 MB/s Sep 05 05:11:25 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c39187b-772a-4d4b-a638-5714f8b53d8a]: (4, 'raw') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:11:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:26 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD Sep 05 05:11:26 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:26 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD" returned: 0 in 0.637s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:26 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD Sep 05 05:11:26 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:26 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD" returned: 1 in 0.542s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD' failed. Not Retrying. {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 05:11:26 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Temporary image e8ca337a-b26f-442f-851b-9ec12741d511 is fetched for user b37b2260a3274aa09e29ddc2a1c1345e. {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Flow 'volume_create_manager' (9cd6b0ba-e576-4950-b79c-64d43ae829df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a019751f-fd44-40fc-8c66-3a197cab511a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a019751f-fd44-40fc-8c66-3a197cab511a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-799000681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee8be01d-0b97-4dc0-8c94-b143688a07dd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1622d954c6124a8d880f3c01fcedae40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:11:27Z,use_quota=True,user_id='e30ac61b08ca4e30bea1cc8509fa4adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd2e27e-2171-4d2a-889c-6ae22dd2fc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd2e27e-2171-4d2a-889c-6ae22dd2fc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cdce760-4c85-4698-9756-d5eb3de867a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cdce760-4c85-4698-9756-d5eb3de867a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee8be01d-0b97-4dc0-8c94-b143688a07dd', 'volume_name': 'volume-ee8be01d-0b97-4dc0-8c94-b143688a07dd', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6dbd56d-6af3-400b-851e-9078b41b6245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6dbd56d-6af3-400b-851e-9078b41b6245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e73e17-c786-42b4-a862-85d1584667b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:27 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Volume ee8be01d-0b97-4dc0-8c94-b143688a07dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee8be01d-0b97-4dc0-8c94-b143688a07dd', 'volume_size': 1} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-799000681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee8be01d-0b97-4dc0-8c94-b143688a07dd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1622d954c6124a8d880f3c01fcedae40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:11:27Z,use_quota=True,user_id='e30ac61b08ca4e30bea1cc8509fa4adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Creating volume ee8be01d-0b97-4dc0-8c94-b143688a07dd {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:11:27 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee8be01d-0b97-4dc0-8c94-b143688a07dd 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8aac08-a5aa-4cfc-8a79-fa685eaf9706]: (4, 'raw') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:27 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee8be01d-0b97-4dc0-8c94-b143688a07dd 1073741824 Sep 05 05:11:27 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:27 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD Sep 05 05:11:27 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:27 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD" returned: 0 in 0.544s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:27 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee8be01d-0b97-4dc0-8c94-b143688a07dd 1073741824" returned: 0 in 0.670s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:28 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD Sep 05 05:11:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee8be01d-0b97-4dc0-8c94-b143688a07dd {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:28 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:28 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee8be01d-0b97-4dc0-8c94-b143688a07dd Sep 05 05:11:28 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:28 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD" returned: 1 in 0.514s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD' failed. Not Retrying. {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 05:11:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:11:28 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee8be01d-0b97-4dc0-8c94-b143688a07dd" returned: 0 in 0.413s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:11:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:11:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.056s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:11:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa04cef7-354e-4dee-baf5-a8cfdbe74575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19aee8b72b354fdd8c000808c0a15f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:11:25Z,use_quota=True,user_id='b37b2260a3274aa09e29ddc2a1c1345e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:11:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Creating volume fa04cef7-354e-4dee-baf5-a8cfdbe74575 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:11:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:11:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:11:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:11:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:11:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:11:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:11:28 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:11:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa04cef7-354e-4dee-baf5-a8cfdbe74575 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e73e17-c786-42b4-a862-85d1584667b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee8be01d-0b97-4dc0-8c94-b143688a07dd', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7e3647-d388-4633-87d0-938e7bb64f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:28 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa04cef7-354e-4dee-baf5-a8cfdbe74575 1073741824 Sep 05 05:11:28 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:28 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Volume volume-ee8be01d-0b97-4dc0-8c94-b143688a07dd (ee8be01d-0b97-4dc0-8c94-b143688a07dd): created successfully Sep 05 05:11:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7e3647-d388-4633-87d0-938e7bb64f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Flow 'volume_create_manager' (9cd6b0ba-e576-4950-b79c-64d43ae829df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:11:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-568ef4a6-5902-48c5-be3e-eefeb05760a8 tempest-VolumesActionsTest-1530445118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:11:28 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-8423aa55-04d2-4361-804c-3f7364cc2789 tempest-VolumesListTestJSON-67544199 None] Created volume successfully. Sep 05 05:11:29 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa04cef7-354e-4dee-baf5-a8cfdbe74575 1073741824" returned: 0 in 0.572s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa04cef7-354e-4dee-baf5-a8cfdbe74575 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:29 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa04cef7-354e-4dee-baf5-a8cfdbe74575 Sep 05 05:11:29 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:29 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa04cef7-354e-4dee-baf5-a8cfdbe74575" returned: 0 in 0.299s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:29 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:11:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:11:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-568ef4a6-5902-48c5-be3e-eefeb05760a8 tempest-VolumesActionsTest-1530445118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.799s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:11:29 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60efa93-5386-498d-935d-f23af9039697]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:11:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-568ef4a6-5902-48c5-be3e-eefeb05760a8 tempest-VolumesActionsTest-1530445118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:29 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Attempting download of e8ca337a-b26f-442f-851b-9ec12741d511 ((None, [{'url': 'file:///opt/stack/data/glance/images/e8ca337a-b26f-442f-851b-9ec12741d511', 'metadata': {}}])) to volume fa04cef7-354e-4dee-baf5-a8cfdbe74575. {{(pid=89331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 05:11:29 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4077d2-8286-4880-92ef-a6b4e03c0f14]: (4, 'raw') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:11:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e8ca337a-b26f-442f-851b-9ec12741d511_v3khw30a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:29 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f Sep 05 05:11:29 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:29 devstack sudo[100205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e8ca337a-b26f-442f-851b-9ec12741d511_v3khw30a Sep 05 05:11:29 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:30 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-568ef4a6-5902-48c5-be3e-eefeb05760a8 tempest-VolumesActionsTest-1530445118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f" returned: 0 in 0.946s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:30 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[329465fb-4dd7-4f24-ba9e-62229c92d61c]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:11:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-568ef4a6-5902-48c5-be3e-eefeb05760a8 tempest-VolumesActionsTest-1530445118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:30 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e8ca337a-b26f-442f-851b-9ec12741d511_v3khw30a" returned: 0 in 0.824s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8ca337a-b26f-442f-851b-9ec12741d511_v3khw30a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:30 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f Sep 05 05:11:30 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:30 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8ca337a-b26f-442f-851b-9ec12741d511_v3khw30a Sep 05 05:11:30 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:31 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-568ef4a6-5902-48c5-be3e-eefeb05760a8 tempest-VolumesActionsTest-1530445118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f" returned: 0 in 0.676s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-568ef4a6-5902-48c5-be3e-eefeb05760a8 tempest-VolumesActionsTest-1530445118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f /opt/stack/data/cinder/conversion/39594f6f-d41b-4554-92a6-0fab8b4f7d3f.temp_image.70242bb0-b474-444f-81b0-5aea9ca512a5y24ulpbb.img {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:31 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f /opt/stack/data/cinder/conversion/39594f6f-d41b-4554-92a6-0fab8b4f7d3f.temp_image.70242bb0-b474-444f-81b0-5aea9ca512a5y24ulpbb.img Sep 05 05:11:31 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:31 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8ca337a-b26f-442f-851b-9ec12741d511_v3khw30a" returned: 1 in 0.690s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8ca337a-b26f-442f-851b-9ec12741d511_v3khw30a' failed. Not Retrying. {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 05:11:31 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[719ef20c-2a86-443e-8bde-4ed790e1809a]: (4, 'raw') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:11:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:31 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD Sep 05 05:11:31 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:31 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD" returned: 0 in 0.550s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:32 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD Sep 05 05:11:32 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:32 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD" returned: 1 in 1.005s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD' failed. Not Retrying. {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 05:11:32 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] e8ca337a-b26f-442f-851b-9ec12741d511 was raw, converting to qcow2 {{(pid=89331) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 05:11:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa04cef7-354e-4dee-baf5-a8cfdbe74575 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:32 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa04cef7-354e-4dee-baf5-a8cfdbe74575 Sep 05 05:11:32 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:34 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ecd9228f-c437-43d6-bf09-f8bec61defc2 tempest-VolumesListTestJSON-67544199 None] Acquiring lock "cinder-ee8be01d-0b97-4dc0-8c94-b143688a07dd-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:34 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ecd9228f-c437-43d6-bf09-f8bec61defc2 tempest-VolumesListTestJSON-67544199 None] Lock "cinder-ee8be01d-0b97-4dc0-8c94-b143688a07dd-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:34 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ecd9228f-c437-43d6-bf09-f8bec61defc2 tempest-VolumesListTestJSON-67544199 None] Acquiring lock "cinder-quobyte-ee8be01d-0b97-4dc0-8c94-b143688a07dd" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:34 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ecd9228f-c437-43d6-bf09-f8bec61defc2 tempest-VolumesListTestJSON-67544199 None] Lock "cinder-quobyte-ee8be01d-0b97-4dc0-8c94-b143688a07dd" acquired by "delete_volume" :: waited 0.041s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:34 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ae6758-da67-4f29-867e-a20b2ca131cc]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:11:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ecd9228f-c437-43d6-bf09-f8bec61defc2 tempest-VolumesListTestJSON-67544199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee8be01d-0b97-4dc0-8c94-b143688a07dd {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:34 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee8be01d-0b97-4dc0-8c94-b143688a07dd Sep 05 05:11:34 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:34 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa04cef7-354e-4dee-baf5-a8cfdbe74575" returned: 0 in 2.069s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:34 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e8ca337a-b26f-442f-851b-9ec12741d511_jsda9yledevstack@QuobyteHD, size 0.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa04cef7-354e-4dee-baf5-a8cfdbe74575 {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:11:34 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Converted 0.00 MB image at 0.00 MB/s Sep 05 05:11:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa04cef7-354e-4dee-baf5-a8cfdbe74575 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:34 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa04cef7-354e-4dee-baf5-a8cfdbe74575 1G Sep 05 05:11:34 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:35 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ecd9228f-c437-43d6-bf09-f8bec61defc2 tempest-VolumesListTestJSON-67544199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee8be01d-0b97-4dc0-8c94-b143688a07dd" returned: 0 in 1.109s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ecd9228f-c437-43d6-bf09-f8bec61defc2 tempest-VolumesListTestJSON-67544199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee8be01d-0b97-4dc0-8c94-b143688a07dd {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:35 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee8be01d-0b97-4dc0-8c94-b143688a07dd Sep 05 05:11:35 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:35 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa04cef7-354e-4dee-baf5-a8cfdbe74575 1G" returned: 0 in 1.099s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:35 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Downloaded image e8ca337a-b26f-442f-851b-9ec12741d511 ((None, [{'url': 'file:///opt/stack/data/glance/images/e8ca337a-b26f-442f-851b-9ec12741d511', 'metadata': {}}])) to volume fa04cef7-354e-4dee-baf5-a8cfdbe74575 successfully. {{(pid=89331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 05:11:35 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Temporary image e8ca337a-b26f-442f-851b-9ec12741d511 for user b37b2260a3274aa09e29ddc2a1c1345e is deleted. {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 05:11:35 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Marking volume fa04cef7-354e-4dee-baf5-a8cfdbe74575 as bootable. {{(pid=89331) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 05:11:36 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Copying metadata from image e8ca337a-b26f-442f-851b-9ec12741d511 to fa04cef7-354e-4dee-baf5-a8cfdbe74575. {{(pid=89331) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 05:11:36 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Creating volume glance metadata for volume fa04cef7-354e-4dee-baf5-a8cfdbe74575 backed by image e8ca337a-b26f-442f-851b-9ec12741d511 with: {'image_id': 'e8ca337a-b26f-442f-851b-9ec12741d511', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7b11baf0022158b3a30464a467e81107', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89331) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 05:11:36 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead9ea08-1b1f-4e7e-b54f-19d17a955aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa04cef7-354e-4dee-baf5-a8cfdbe74575', 'volume_size': 1, 'image_id': 'e8ca337a-b26f-442f-851b-9ec12741d511', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e8ca337a-b26f-442f-851b-9ec12741d511', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7b11baf0022158b3a30464a467e81107', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '19aee8b72b354fdd8c000808c0a15f05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd28a26a38de3d84863bcfd7b279053a156770d14d0265957cae9f6e2562dabe3e8dbd4f1325cd0b0d92ecee6cd5c225b73301ab396aec5acfc6ca503bee68bc8', 'id': 'e8ca337a-b26f-442f-851b-9ec12741d511', 'created_at': datetime.datetime(2026, 9, 5, 3, 11, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 3, 11, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e8ca337a-b26f-442f-851b-9ec12741d511/file', 'properties': {}}, 'image_service': }' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007997c8-1c9d-4a90-b4f6-75a41e1aff20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ecd9228f-c437-43d6-bf09-f8bec61defc2 tempest-VolumesListTestJSON-67544199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee8be01d-0b97-4dc0-8c94-b143688a07dd" returned: 0 in 0.741s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ecd9228f-c437-43d6-bf09-f8bec61defc2 tempest-VolumesListTestJSON-67544199 None] Lock "cinder-quobyte-ee8be01d-0b97-4dc0-8c94-b143688a07dd" released by "delete_volume" :: held 2.011s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:36 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Volume volume-fa04cef7-354e-4dee-baf5-a8cfdbe74575 (fa04cef7-354e-4dee-baf5-a8cfdbe74575): created successfully Sep 05 05:11:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007997c8-1c9d-4a90-b4f6-75a41e1aff20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Flow 'volume_create_manager' (18a69137-f63b-41ef-8dc6-23585ac003ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:11:36 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-77a765bb-dec5-472b-b677-43d3681bb5d2 tempest-VolumeImageDependencyTests-596779112 None] Created volume successfully. Sep 05 05:11:36 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-ecd9228f-c437-43d6-bf09-f8bec61defc2 tempest-VolumesListTestJSON-67544199 None] Created reservations ['d5d5d1ce-6f93-4a84-b031-28d869cd5124', 'a4bfb92a-ec00-4149-a510-df3bde499f78', 'e6334c23-aeff-4758-b885-6bc7ed6320a8', '1b4a34f4-0288-409e-b0f7-ad6443075688'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:11:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ecd9228f-c437-43d6-bf09-f8bec61defc2 tempest-VolumesListTestJSON-67544199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:11:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ecd9228f-c437-43d6-bf09-f8bec61defc2 tempest-VolumesListTestJSON-67544199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:11:36 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ecd9228f-c437-43d6-bf09-f8bec61defc2 tempest-VolumesListTestJSON-67544199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:11:36 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ecd9228f-c437-43d6-bf09-f8bec61defc2 tempest-VolumesListTestJSON-67544199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:11:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ecd9228f-c437-43d6-bf09-f8bec61defc2 tempest-VolumesListTestJSON-67544199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:11:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ecd9228f-c437-43d6-bf09-f8bec61defc2 tempest-VolumesListTestJSON-67544199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:37 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:11:37 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ffa1212e-968e-41d6-acc4-24dfa4b6d36b tempest-VolumeImageDependencyTests-596779112 None] Acquiring lock "cinder-fa04cef7-354e-4dee-baf5-a8cfdbe74575-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ffa1212e-968e-41d6-acc4-24dfa4b6d36b tempest-VolumeImageDependencyTests-596779112 None] Lock "cinder-fa04cef7-354e-4dee-baf5-a8cfdbe74575-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:37 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ecd9228f-c437-43d6-bf09-f8bec61defc2 tempest-VolumesListTestJSON-67544199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.759s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:37 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-ecd9228f-c437-43d6-bf09-f8bec61defc2 tempest-VolumesListTestJSON-67544199 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:11:37 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ecd9228f-c437-43d6-bf09-f8bec61defc2 tempest-VolumesListTestJSON-67544199 None] Deleted volume successfully. Sep 05 05:11:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ecd9228f-c437-43d6-bf09-f8bec61defc2 tempest-VolumesListTestJSON-67544199 None] Lock "cinder-ee8be01d-0b97-4dc0-8c94-b143688a07dd-delete_volume" released by "delete_volume" :: held 3.614s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ffa1212e-968e-41d6-acc4-24dfa4b6d36b tempest-VolumeImageDependencyTests-596779112 None] Acquiring lock "cinder-quobyte-fa04cef7-354e-4dee-baf5-a8cfdbe74575" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ffa1212e-968e-41d6-acc4-24dfa4b6d36b tempest-VolumeImageDependencyTests-596779112 None] Lock "cinder-quobyte-fa04cef7-354e-4dee-baf5-a8cfdbe74575" acquired by "delete_volume" :: waited 0.088s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[14eef4f0-0d0f-4807-b2ab-a2874da169f7]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffa1212e-968e-41d6-acc4-24dfa4b6d36b tempest-VolumeImageDependencyTests-596779112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa04cef7-354e-4dee-baf5-a8cfdbe74575 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3f5c6156-9728-41ef-aab7-802bce013ed8 tempest-VolumesListTestJSON-67544199 None] Acquiring lock "cinder-1127bb9e-6871-4a64-8890-cea7bdbe327b-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3f5c6156-9728-41ef-aab7-802bce013ed8 tempest-VolumesListTestJSON-67544199 None] Lock "cinder-1127bb9e-6871-4a64-8890-cea7bdbe327b-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:11:38 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:38 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa04cef7-354e-4dee-baf5-a8cfdbe74575 Sep 05 05:11:38 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Flow 'volume_create_manager' (f16b8797-3417-41ad-b4ef-89a6724bd585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9172270e-f172-4140-9921-ebcbf1494c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-568ef4a6-5902-48c5-be3e-eefeb05760a8 tempest-VolumesActionsTest-1530445118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f /opt/stack/data/cinder/conversion/39594f6f-d41b-4554-92a6-0fab8b4f7d3f.temp_image.70242bb0-b474-444f-81b0-5aea9ca512a5y24ulpbb.img" returned: 0 in 7.441s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9172270e-f172-4140-9921-ebcbf1494c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1819363092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6312b723-7d69-429d-b14c-c14b17251070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aa5ebc51fdf4270a5cef275433861d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:11:38Z,use_quota=True,user_id='4b1c19b227b843a0ae511c939ac57248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db4b8d45-e6cc-4a7f-8d36-9a2082bf3496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db4b8d45-e6cc-4a7f-8d36-9a2082bf3496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ddfc5b-0872-4c92-95f4-5bc0b7445034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ddfc5b-0872-4c92-95f4-5bc0b7445034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6312b723-7d69-429d-b14c-c14b17251070', 'volume_name': 'volume-6312b723-7d69-429d-b14c-c14b17251070', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6a253d-edf9-40f7-9b5b-356254c23068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6a253d-edf9-40f7-9b5b-356254c23068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035941d7-3ea1-4f84-9b8a-a16525127b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:38 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Volume 6312b723-7d69-429d-b14c-c14b17251070: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6312b723-7d69-429d-b14c-c14b17251070', 'volume_size': 1} Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1cb356-2ee6-43c8-8dba-f698733df7b4]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-568ef4a6-5902-48c5-be3e-eefeb05760a8 tempest-VolumesActionsTest-1530445118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3f5c6156-9728-41ef-aab7-802bce013ed8 tempest-VolumesListTestJSON-67544199 None] Acquiring lock "cinder-quobyte-1127bb9e-6871-4a64-8890-cea7bdbe327b" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3f5c6156-9728-41ef-aab7-802bce013ed8 tempest-VolumesListTestJSON-67544199 None] Lock "cinder-quobyte-1127bb9e-6871-4a64-8890-cea7bdbe327b" acquired by "delete_volume" :: waited 0.023s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9485b1-7e24-477e-8a5d-9845bd474406]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3f5c6156-9728-41ef-aab7-802bce013ed8 tempest-VolumesListTestJSON-67544199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1127bb9e-6871-4a64-8890-cea7bdbe327b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:38 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f Sep 05 05:11:38 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:38 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1127bb9e-6871-4a64-8890-cea7bdbe327b Sep 05 05:11:38 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:38 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffa1212e-968e-41d6-acc4-24dfa4b6d36b tempest-VolumeImageDependencyTests-596779112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa04cef7-354e-4dee-baf5-a8cfdbe74575" returned: 0 in 0.791s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffa1212e-968e-41d6-acc4-24dfa4b6d36b tempest-VolumeImageDependencyTests-596779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa04cef7-354e-4dee-baf5-a8cfdbe74575 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:38 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa04cef7-354e-4dee-baf5-a8cfdbe74575 Sep 05 05:11:38 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:39 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3f5c6156-9728-41ef-aab7-802bce013ed8 tempest-VolumesListTestJSON-67544199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1127bb9e-6871-4a64-8890-cea7bdbe327b" returned: 0 in 0.431s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3f5c6156-9728-41ef-aab7-802bce013ed8 tempest-VolumesListTestJSON-67544199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1127bb9e-6871-4a64-8890-cea7bdbe327b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:39 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffa1212e-968e-41d6-acc4-24dfa4b6d36b tempest-VolumeImageDependencyTests-596779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa04cef7-354e-4dee-baf5-a8cfdbe74575" returned: 0 in 0.281s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:39 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1127bb9e-6871-4a64-8890-cea7bdbe327b Sep 05 05:11:39 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ffa1212e-968e-41d6-acc4-24dfa4b6d36b tempest-VolumeImageDependencyTests-596779112 None] Lock "cinder-quobyte-fa04cef7-354e-4dee-baf5-a8cfdbe74575" released by "delete_volume" :: held 1.219s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:UPDATE=113,cinder:SELECT=112,cinder:INSERT=34,cinder:DELETE=9 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=110,cinder:INSERT=43,cinder:UPDATE=122,cinder:DELETE=9 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-ffa1212e-968e-41d6-acc4-24dfa4b6d36b tempest-VolumeImageDependencyTests-596779112 None] Created reservations ['e4392a68-c4a3-45d1-b6cd-386b72511c46', '76df8566-6503-47df-9a77-f50d30c50a71', '55ecbdcb-4180-4d97-8f45-b2bb176d26c4', '4427f0be-7d71-4390-9a52-544e5c522a3a'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:11:39 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-568ef4a6-5902-48c5-be3e-eefeb05760a8 tempest-VolumesActionsTest-1530445118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f" returned: 0 in 0.697s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-568ef4a6-5902-48c5-be3e-eefeb05760a8 tempest-VolumesActionsTest-1530445118 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f, size 1024.00 MB, duration 7.44 sec, destination /opt/stack/data/cinder/conversion/39594f6f-d41b-4554-92a6-0fab8b4f7d3f.temp_image.70242bb0-b474-444f-81b0-5aea9ca512a5y24ulpbb.img {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:11:39 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-568ef4a6-5902-48c5-be3e-eefeb05760a8 tempest-VolumesActionsTest-1530445118 None] Converted 1024.00 MB image at 137.59 MB/s Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-568ef4a6-5902-48c5-be3e-eefeb05760a8 tempest-VolumesActionsTest-1530445118 None] 70242bb0-b474-444f-81b0-5aea9ca512a5 was raw, no need to convert to raw {{(pid=89331) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffa1212e-968e-41d6-acc4-24dfa4b6d36b tempest-VolumeImageDependencyTests-596779112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffa1212e-968e-41d6-acc4-24dfa4b6d36b tempest-VolumeImageDependencyTests-596779112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ffa1212e-968e-41d6-acc4-24dfa4b6d36b tempest-VolumeImageDependencyTests-596779112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ffa1212e-968e-41d6-acc4-24dfa4b6d36b tempest-VolumeImageDependencyTests-596779112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffa1212e-968e-41d6-acc4-24dfa4b6d36b tempest-VolumeImageDependencyTests-596779112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffa1212e-968e-41d6-acc4-24dfa4b6d36b tempest-VolumeImageDependencyTests-596779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:39 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:11:39 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:39 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3f5c6156-9728-41ef-aab7-802bce013ed8 tempest-VolumesListTestJSON-67544199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1127bb9e-6871-4a64-8890-cea7bdbe327b" returned: 0 in 0.397s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3f5c6156-9728-41ef-aab7-802bce013ed8 tempest-VolumesListTestJSON-67544199 None] Lock "cinder-quobyte-1127bb9e-6871-4a64-8890-cea7bdbe327b" released by "delete_volume" :: held 0.874s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-3f5c6156-9728-41ef-aab7-802bce013ed8 tempest-VolumesListTestJSON-67544199 None] Created reservations ['7e46c172-2289-4ed6-88d1-5b78471cd280', 'c903e3a1-e7b8-4095-a11f-789c34bdf616', '976854cd-e1cc-4dd4-8b13-149a532eb3ba', '3cc25ada-d19b-49b6-aeed-e1b219cfd7ed'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3f5c6156-9728-41ef-aab7-802bce013ed8 tempest-VolumesListTestJSON-67544199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3f5c6156-9728-41ef-aab7-802bce013ed8 tempest-VolumesListTestJSON-67544199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3f5c6156-9728-41ef-aab7-802bce013ed8 tempest-VolumesListTestJSON-67544199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3f5c6156-9728-41ef-aab7-802bce013ed8 tempest-VolumesListTestJSON-67544199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3f5c6156-9728-41ef-aab7-802bce013ed8 tempest-VolumesListTestJSON-67544199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3f5c6156-9728-41ef-aab7-802bce013ed8 tempest-VolumesListTestJSON-67544199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:39 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:11:39 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:39 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffa1212e-968e-41d6-acc4-24dfa4b6d36b tempest-VolumeImageDependencyTests-596779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.371s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-ffa1212e-968e-41d6-acc4-24dfa4b6d36b tempest-VolumeImageDependencyTests-596779112 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:11:39 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ffa1212e-968e-41d6-acc4-24dfa4b6d36b tempest-VolumeImageDependencyTests-596779112 None] Deleted volume successfully. Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ffa1212e-968e-41d6-acc4-24dfa4b6d36b tempest-VolumeImageDependencyTests-596779112 None] Lock "cinder-fa04cef7-354e-4dee-baf5-a8cfdbe74575-delete_volume" released by "delete_volume" :: held 2.132s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:39 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3f5c6156-9728-41ef-aab7-802bce013ed8 tempest-VolumesListTestJSON-67544199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.295s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:39 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-3f5c6156-9728-41ef-aab7-802bce013ed8 tempest-VolumesListTestJSON-67544199 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:11:39 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-3f5c6156-9728-41ef-aab7-802bce013ed8 tempest-VolumesListTestJSON-67544199 None] Deleted volume successfully. Sep 05 05:11:40 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3f5c6156-9728-41ef-aab7-802bce013ed8 tempest-VolumesListTestJSON-67544199 None] Lock "cinder-1127bb9e-6871-4a64-8890-cea7bdbe327b-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:40 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3d644658-03ff-46ca-8049-63c58864f860 tempest-VolumesListTestJSON-67544199 None] Acquiring lock "cinder-9a232609-7f15-4b85-934f-bfcb863f2600-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:40 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3d644658-03ff-46ca-8049-63c58864f860 tempest-VolumesListTestJSON-67544199 None] Lock "cinder-9a232609-7f15-4b85-934f-bfcb863f2600-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3d644658-03ff-46ca-8049-63c58864f860 tempest-VolumesListTestJSON-67544199 None] Acquiring lock "cinder-quobyte-9a232609-7f15-4b85-934f-bfcb863f2600" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:11:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3d644658-03ff-46ca-8049-63c58864f860 tempest-VolumesListTestJSON-67544199 None] Lock "cinder-quobyte-9a232609-7f15-4b85-934f-bfcb863f2600" acquired by "delete_volume" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:11:41 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[837ad6e6-dca1-4f05-89fa-e01236719ef6]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:11:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d644658-03ff-46ca-8049-63c58864f860 tempest-VolumesListTestJSON-67544199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9a232609-7f15-4b85-934f-bfcb863f2600 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:41 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9a232609-7f15-4b85-934f-bfcb863f2600 Sep 05 05:11:41 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:41 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d644658-03ff-46ca-8049-63c58864f860 tempest-VolumesListTestJSON-67544199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9a232609-7f15-4b85-934f-bfcb863f2600" returned: 0 in 0.654s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d644658-03ff-46ca-8049-63c58864f860 tempest-VolumesListTestJSON-67544199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9a232609-7f15-4b85-934f-bfcb863f2600 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:41 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9a232609-7f15-4b85-934f-bfcb863f2600 Sep 05 05:11:41 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d644658-03ff-46ca-8049-63c58864f860 tempest-VolumesListTestJSON-67544199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9a232609-7f15-4b85-934f-bfcb863f2600" returned: 0 in 0.441s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:42 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:42 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3d644658-03ff-46ca-8049-63c58864f860 tempest-VolumesListTestJSON-67544199 None] Lock "cinder-quobyte-9a232609-7f15-4b85-934f-bfcb863f2600" released by "delete_volume" :: held 1.168s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:42 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-3d644658-03ff-46ca-8049-63c58864f860 tempest-VolumesListTestJSON-67544199 None] Created reservations ['2498f40d-abd9-4403-b632-483a0affa822', '7526713b-c8bd-4cc8-91e7-983da9df2e33', '4094ff8f-9349-414f-b485-889e6fcbacd6', 'bce83881-704a-4750-a2f7-e51e448073be'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:11:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3d644658-03ff-46ca-8049-63c58864f860 tempest-VolumesListTestJSON-67544199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:11:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3d644658-03ff-46ca-8049-63c58864f860 tempest-VolumesListTestJSON-67544199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:11:42 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3d644658-03ff-46ca-8049-63c58864f860 tempest-VolumesListTestJSON-67544199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:11:42 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3d644658-03ff-46ca-8049-63c58864f860 tempest-VolumesListTestJSON-67544199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:11:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3d644658-03ff-46ca-8049-63c58864f860 tempest-VolumesListTestJSON-67544199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:11:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d644658-03ff-46ca-8049-63c58864f860 tempest-VolumesListTestJSON-67544199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:42 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:11:42 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:42 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d644658-03ff-46ca-8049-63c58864f860 tempest-VolumesListTestJSON-67544199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.332s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:42 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-3d644658-03ff-46ca-8049-63c58864f860 tempest-VolumesListTestJSON-67544199 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:11:42 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-3d644658-03ff-46ca-8049-63c58864f860 tempest-VolumesListTestJSON-67544199 None] Deleted volume successfully. Sep 05 05:11:42 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3d644658-03ff-46ca-8049-63c58864f860 tempest-VolumesListTestJSON-67544199 None] Lock "cinder-9a232609-7f15-4b85-934f-bfcb863f2600-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:11:44 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:11:44 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Flow 'volume_create_manager' (48abef8e-5daa-4f86-a238-8ea7e80f05d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:11:44 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78981801-f2e9-43e6-be63-b075e3952723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:44 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78981801-f2e9-43e6-be63-b075e3952723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9797b56-ea64-4962-a43e-f41806e4d958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0bfb5e3f7042cbb3613dcfca6cd09d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:11:45Z,use_quota=True,user_id='15281123b8114afba12449448b73ec99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7954fff7-0280-4814-b542-c7e98069c00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7954fff7-0280-4814-b542-c7e98069c00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e9a17b-ef17-4871-831e-2e5633048196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e9a17b-ef17-4871-831e-2e5633048196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9797b56-ea64-4962-a43e-f41806e4d958', 'volume_name': 'volume-f9797b56-ea64-4962-a43e-f41806e4d958', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe61fd0-305f-49a2-b8a5-7917cfdff04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe61fd0-305f-49a2-b8a5-7917cfdff04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbabb55-a9ec-4e32-9a9f-82c6dfcc66f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:45 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Volume f9797b56-ea64-4962-a43e-f41806e4d958: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9797b56-ea64-4962-a43e-f41806e4d958', 'volume_size': 1} Sep 05 05:11:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:11:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:11:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:11:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:11:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:11:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:11:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:11:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:11:49 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:11:49 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:11:49 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Sep 05 05:11:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.262s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:11:49 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:11:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager._thread_info {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:11:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread count: 28 {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 05:11:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread info: [<_MainThread(MainThread, started 139182109970560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 05:11:54 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:INSERT=5,cinder:UPDATE=27,cinder:SELECT=15,cinder:DELETE=2 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:11:54 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=13,cinder:INSERT=7,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:11:59 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:11:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Flow 'volume_create_manager' (f126d027-c27b-4120-a42d-8da1e2ae6f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:11:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (240cc35d-fff2-4b95-bf15-854346c34df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (240cc35d-fff2-4b95-bf15-854346c34df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1623564024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdaea41b-1ffc-483b-92bb-6eca0804462f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85443d45c6f6476db28bd21fe4c3b2ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:11:59Z,use_quota=True,user_id='036aaf35f79d4d9b8f12aa9de9e08d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7dd763-a65c-4631-9d66-eb37bce3fa06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7dd763-a65c-4631-9d66-eb37bce3fa06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39df3e28-241b-48a9-818b-ade0b3a61c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39df3e28-241b-48a9-818b-ade0b3a61c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdaea41b-1ffc-483b-92bb-6eca0804462f', 'volume_name': 'volume-bdaea41b-1ffc-483b-92bb-6eca0804462f', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b271469b-af2b-4ca9-8be6-36e62d0adcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b271469b-af2b-4ca9-8be6-36e62d0adcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:11:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3e31fa-3702-4833-b8d8-5153a321d707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:11:59 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Volume bdaea41b-1ffc-483b-92bb-6eca0804462f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdaea41b-1ffc-483b-92bb-6eca0804462f', 'volume_size': 1} Sep 05 05:11:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-568ef4a6-5902-48c5-be3e-eefeb05760a8 tempest-VolumesActionsTest-1530445118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.600s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-568ef4a6-5902-48c5-be3e-eefeb05760a8 tempest-VolumesActionsTest-1530445118 None] Uploaded volume to glance image-id: 70242bb0-b474-444f-81b0-5aea9ca512a5. {{(pid=89331) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.385s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1819363092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6312b723-7d69-429d-b14c-c14b17251070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aa5ebc51fdf4270a5cef275433861d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:11:38Z,use_quota=True,user_id='4b1c19b227b843a0ae511c939ac57248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Creating volume 6312b723-7d69-429d-b14c-c14b17251070 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:12:03 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6312b723-7d69-429d-b14c-c14b17251070 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:03 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6312b723-7d69-429d-b14c-c14b17251070 1073741824 Sep 05 05:12:03 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:03 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-568ef4a6-5902-48c5-be3e-eefeb05760a8 tempest-VolumesActionsTest-1530445118 None] Copy volume to image completed successfully. Sep 05 05:12:03 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6312b723-7d69-429d-b14c-c14b17251070 1073741824" returned: 0 in 0.420s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6312b723-7d69-429d-b14c-c14b17251070 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:03 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6312b723-7d69-429d-b14c-c14b17251070 Sep 05 05:12:03 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:03 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6312b723-7d69-429d-b14c-c14b17251070" returned: 0 in 0.237s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.677s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9797b56-ea64-4962-a43e-f41806e4d958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0bfb5e3f7042cbb3613dcfca6cd09d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:11:45Z,use_quota=True,user_id='15281123b8114afba12449448b73ec99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Creating volume f9797b56-ea64-4962-a43e-f41806e4d958 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:12:03 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9797b56-ea64-4962-a43e-f41806e4d958 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:03 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9797b56-ea64-4962-a43e-f41806e4d958 1073741824 Sep 05 05:12:03 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035941d7-3ea1-4f84-9b8a-a16525127b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6312b723-7d69-429d-b14c-c14b17251070', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ee60da-e99f-446f-b712-834f4e847d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:03 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Volume volume-6312b723-7d69-429d-b14c-c14b17251070 (6312b723-7d69-429d-b14c-c14b17251070): created successfully Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ee60da-e99f-446f-b712-834f4e847d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Flow 'volume_create_manager' (f16b8797-3417-41ad-b4ef-89a6724bd585) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:12:03 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-823f0d5d-4c4e-4226-b0ab-f6e0f515e6a5 tempest-TestMinimumBasicScenario-1051796474 None] Created volume successfully. Sep 05 05:12:04 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9797b56-ea64-4962-a43e-f41806e4d958 1073741824" returned: 0 in 0.419s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9797b56-ea64-4962-a43e-f41806e4d958 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:04 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9797b56-ea64-4962-a43e-f41806e4d958 Sep 05 05:12:04 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:04 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9797b56-ea64-4962-a43e-f41806e4d958" returned: 0 in 0.268s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:12:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.984s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1623564024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdaea41b-1ffc-483b-92bb-6eca0804462f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85443d45c6f6476db28bd21fe4c3b2ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:11:59Z,use_quota=True,user_id='036aaf35f79d4d9b8f12aa9de9e08d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:12:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Creating volume bdaea41b-1ffc-483b-92bb-6eca0804462f {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:12:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:12:04 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:12:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbabb55-a9ec-4e32-9a9f-82c6dfcc66f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9797b56-ea64-4962-a43e-f41806e4d958', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:04 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f 1073741824 Sep 05 05:12:04 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec35cdc-62b1-46fd-a252-4021cc60c8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:04 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Volume volume-f9797b56-ea64-4962-a43e-f41806e4d958 (f9797b56-ea64-4962-a43e-f41806e4d958): created successfully Sep 05 05:12:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec35cdc-62b1-46fd-a252-4021cc60c8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Flow 'volume_create_manager' (48abef8e-5daa-4f86-a238-8ea7e80f05d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:12:04 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-b1c89b65-f230-417d-9cb2-5029b1a23fc0 tempest-CinderUnicodeTest-65203055 None] Created volume successfully. Sep 05 05:12:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:05 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f 1073741824" returned: 0 in 0.541s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:05 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f Sep 05 05:12:05 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:05 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f" returned: 0 in 0.288s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:12:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.418s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3e31fa-3702-4833-b8d8-5153a321d707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdaea41b-1ffc-483b-92bb-6eca0804462f', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df43acf2-94bc-4bca-ad6d-431202cbb654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:05 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[15243713-54b1-4c56-aacc-a5ad822a78f7]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:05 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Volume volume-bdaea41b-1ffc-483b-92bb-6eca0804462f (bdaea41b-1ffc-483b-92bb-6eca0804462f): created successfully Sep 05 05:12:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df43acf2-94bc-4bca-ad6d-431202cbb654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Flow 'volume_create_manager' (f126d027-c27b-4120-a42d-8da1e2ae6f92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:12:05 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-b7bc3ab4-647f-4f5e-a54a-f3dc7f576583 tempest-VolumesSnapshotTestJSON-1994781731 None] Created volume successfully. Sep 05 05:12:05 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f Sep 05 05:12:05 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-7e03fd59-4739-455f-bb78-32560183015f req-8cefdd26-84e6-41ee-b3f0-3e8d6670907f tempest-TestMinimumBasicScenario-1051796474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:05 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f" returned: 0 in 0.438s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:05 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9cd7fd-f776-4b47-99e5-5dd58fb35d41]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:05 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:12:05 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f Sep 05 05:12:05 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Flow 'volume_create_manager' (107fb35a-77c1-41f3-8e3a-0a1fa9062609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:12:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3839f109-1a0e-4fc6-97b4-e8eed10e202e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3839f109-1a0e-4fc6-97b4-e8eed10e202e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:12:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-933255537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb85d009-764c-4df9-876e-7bde4fdb4a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0bfb5e3f7042cbb3613dcfca6cd09d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:12:06Z,use_quota=True,user_id='15281123b8114afba12449448b73ec99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242686d1-a36f-4873-ab35-1209154a53e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242686d1-a36f-4873-ab35-1209154a53e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24c0ae2-2840-40c2-aeee-dee5e0cfa560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24c0ae2-2840-40c2-aeee-dee5e0cfa560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb85d009-764c-4df9-876e-7bde4fdb4a7e', 'volume_name': 'volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e2bcea-3b3a-48df-952a-9ba26e9c50b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e2bcea-3b3a-48df-952a-9ba26e9c50b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca332d5-57fb-43bd-8c71-21b53db51d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:06 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Volume eb85d009-764c-4df9-876e-7bde4fdb4a7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e', 'volume_size': 1} Sep 05 05:12:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:06 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f" returned: 0 in 0.416s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f /opt/stack/data/cinder/conversion/39594f6f-d41b-4554-92a6-0fab8b4f7d3f.temp_image.c5defba0-2cac-4410-88f7-a7df957a4df5mhn_amjw.img {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a14fe93a-9f99-4bb0-bfda-f897feec1a3f tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:06 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f /opt/stack/data/cinder/conversion/39594f6f-d41b-4554-92a6-0fab8b4f7d3f.temp_image.c5defba0-2cac-4410-88f7-a7df957a4df5mhn_amjw.img Sep 05 05:12:06 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:10 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f /opt/stack/data/cinder/conversion/39594f6f-d41b-4554-92a6-0fab8b4f7d3f.temp_image.c5defba0-2cac-4410-88f7-a7df957a4df5mhn_amjw.img" returned: 0 in 4.272s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:10 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[460eab78-d7f1-4b4a-96e5-1efa51b410e0]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:10 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f Sep 05 05:12:10 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:11 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f" returned: 0 in 0.511s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:11 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f, size 1024.00 MB, duration 4.27 sec, destination /opt/stack/data/cinder/conversion/39594f6f-d41b-4554-92a6-0fab8b4f7d3f.temp_image.c5defba0-2cac-4410-88f7-a7df957a4df5mhn_amjw.img {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:12:11 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] Converted 1024.00 MB image at 239.59 MB/s Sep 05 05:12:11 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] c5defba0-2cac-4410-88f7-a7df957a4df5 was raw, converting to qcow2 {{(pid=89331) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 05 05:12:11 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e21b6cc-373a-46fb-8a78-866bb53e09cf]: (4, 'raw') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/39594f6f-d41b-4554-92a6-0fab8b4f7d3f.temp_image.c5defba0-2cac-4410-88f7-a7df957a4df5mhn_amjw.img {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:11 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/39594f6f-d41b-4554-92a6-0fab8b4f7d3f.temp_image.c5defba0-2cac-4410-88f7-a7df957a4df5mhn_amjw.img Sep 05 05:12:11 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:11 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/39594f6f-d41b-4554-92a6-0fab8b4f7d3f.temp_image.c5defba0-2cac-4410-88f7-a7df957a4df5mhn_amjw.img" returned: 0 in 0.331s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/39594f6f-d41b-4554-92a6-0fab8b4f7d3f.temp_image.c5defba0-2cac-4410-88f7-a7df957a4df5mhn_amjw.img {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:11 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/39594f6f-d41b-4554-92a6-0fab8b4f7d3f.temp_image.c5defba0-2cac-4410-88f7-a7df957a4df5mhn_amjw.img Sep 05 05:12:11 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:11 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/39594f6f-d41b-4554-92a6-0fab8b4f7d3f.temp_image.c5defba0-2cac-4410-88f7-a7df957a4df5mhn_amjw.img" returned: 1 in 0.327s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/39594f6f-d41b-4554-92a6-0fab8b4f7d3f.temp_image.c5defba0-2cac-4410-88f7-a7df957a4df5mhn_amjw.img' failed. Not Retrying. {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 05:12:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/39594f6f-d41b-4554-92a6-0fab8b4f7d3f.temp_image.c5defba0-2cac-4410-88f7-a7df957a4df5mhn_amjw.img /opt/stack/data/cinder/conversion/vol_upload_f3bmhsfp {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:11 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/39594f6f-d41b-4554-92a6-0fab8b4f7d3f.temp_image.c5defba0-2cac-4410-88f7-a7df957a4df5mhn_amjw.img /opt/stack/data/cinder/conversion/vol_upload_f3bmhsfp Sep 05 05:12:11 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:11 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/39594f6f-d41b-4554-92a6-0fab8b4f7d3f.temp_image.c5defba0-2cac-4410-88f7-a7df957a4df5mhn_amjw.img /opt/stack/data/cinder/conversion/vol_upload_f3bmhsfp" returned: 0 in 0.258s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:11 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] Image conversion details: src /opt/stack/data/cinder/conversion/39594f6f-d41b-4554-92a6-0fab8b4f7d3f.temp_image.c5defba0-2cac-4410-88f7-a7df957a4df5mhn_amjw.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_f3bmhsfp {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:12:11 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 05 05:12:11 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3261801-de4a-450d-87e0-2136e641c46d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f3bmhsfp {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:12 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f3bmhsfp Sep 05 05:12:12 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:12 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f3bmhsfp" returned: 0 in 0.332s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.226s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] Uploaded volume to glance image-id: c5defba0-2cac-4410-88f7-a7df957a4df5. {{(pid=89331) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 05 05:12:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-7e03fd59-4739-455f-bb78-32560183015f req-8cefdd26-84e6-41ee-b3f0-3e8d6670907f tempest-TestMinimumBasicScenario-1051796474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.948s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-7e03fd59-4739-455f-bb78-32560183015f req-8cefdd26-84e6-41ee-b3f0-3e8d6670907f tempest-TestMinimumBasicScenario-1051796474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.571s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:13 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:12:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-933255537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb85d009-764c-4df9-876e-7bde4fdb4a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0bfb5e3f7042cbb3613dcfca6cd09d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:12:06Z,use_quota=True,user_id='15281123b8114afba12449448b73ec99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:12:13 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Creating volume eb85d009-764c-4df9-876e-7bde4fdb4a7e {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:12:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:13 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:13 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:13 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:12:13 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:12:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:13 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-a106652f-fd67-4890-8c05-715b7244e20f tempest-VolumesActionsTest-1530445118 None] Copy volume to image completed successfully. Sep 05 05:12:13 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e 1073741824 Sep 05 05:12:13 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-7e03fd59-4739-455f-bb78-32560183015f req-8cefdd26-84e6-41ee-b3f0-3e8d6670907f tempest-TestMinimumBasicScenario-1051796474 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136', 'name': 'volume-6312b723-7d69-429d-b14c-c14b17251070', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0c125722-c585-4d7b-b7b3-6d3ee30c0eb0', 'enforce_multipath': True} {{(pid=89331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 05:12:13 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-7e03fd59-4739-455f-bb78-32560183015f req-8cefdd26-84e6-41ee-b3f0-3e8d6670907f tempest-TestMinimumBasicScenario-1051796474 None] attachment_update completed successfully. Sep 05 05:12:14 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e 1073741824" returned: 0 in 0.433s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:14 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e Sep 05 05:12:14 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:14 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e" returned: 0 in 0.266s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:14 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:12:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a14fe93a-9f99-4bb0-bfda-f897feec1a3f tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.092s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:14 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-a14fe93a-9f99-4bb0-bfda-f897feec1a3f tempest-VolumesSnapshotTestJSON-1994781731 None] Creating offline snapshot 111c3aa4-7a2b-4361-be68-60d3fe8b1d89 of volume bdaea41b-1ffc-483b-92bb-6eca0804462f {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:12:14 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca332d5-57fb-43bd-8c71-21b53db51d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:14 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b78e636-413f-4682-8890-a8ebd29882e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:14 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8976f8-d580-43c0-a9f4-0885b23597a2]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a14fe93a-9f99-4bb0-bfda-f897feec1a3f tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:14 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Volume volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e (eb85d009-764c-4df9-876e-7bde4fdb4a7e): created successfully Sep 05 05:12:14 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b78e636-413f-4682-8890-a8ebd29882e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:14 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Flow 'volume_create_manager' (107fb35a-77c1-41f3-8e3a-0a1fa9062609) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:12:14 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-76d317da-b274-4585-873b-c9fd79393a59 tempest-CinderUnicodeTest-65203055 None] Created volume successfully. Sep 05 05:12:14 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f Sep 05 05:12:14 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:14 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a14fe93a-9f99-4bb0-bfda-f897feec1a3f tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f" returned: 0 in 0.404s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a14fe93a-9f99-4bb0-bfda-f897feec1a3f tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.111c3aa4-7a2b-4361-be68-60d3fe8b1d89 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:14 devstack sudo[100922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.111c3aa4-7a2b-4361-be68-60d3fe8b1d89 1G Sep 05 05:12:14 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b73042a7-6a73-441f-a9f5-17dad2358fdc tempest-CinderUnicodeTest-65203055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fe620842-92e2-4e79-bd9a-b52f5a5873bc tempest-VolumesActionsTest-1530445118 None] Acquiring lock "cinder-39594f6f-d41b-4554-92a6-0fab8b4f7d3f-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fe620842-92e2-4e79-bd9a-b52f5a5873bc tempest-VolumesActionsTest-1530445118 None] Lock "cinder-39594f6f-d41b-4554-92a6-0fab8b4f7d3f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fe620842-92e2-4e79-bd9a-b52f5a5873bc tempest-VolumesActionsTest-1530445118 None] Acquiring lock "cinder-quobyte-39594f6f-d41b-4554-92a6-0fab8b4f7d3f" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fe620842-92e2-4e79-bd9a-b52f5a5873bc tempest-VolumesActionsTest-1530445118 None] Lock "cinder-quobyte-39594f6f-d41b-4554-92a6-0fab8b4f7d3f" acquired by "delete_volume" :: waited 0.016s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:15 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc6caca-2bb5-4228-91f5-c057d9d2dcc3]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fe620842-92e2-4e79-bd9a-b52f5a5873bc tempest-VolumesActionsTest-1530445118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:15 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f Sep 05 05:12:15 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:15 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a14fe93a-9f99-4bb0-bfda-f897feec1a3f tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.111c3aa4-7a2b-4361-be68-60d3fe8b1d89 1G" returned: 0 in 0.509s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a14fe93a-9f99-4bb0-bfda-f897feec1a3f tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdaea41b-1ffc-483b-92bb-6eca0804462f -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.111c3aa4-7a2b-4361-be68-60d3fe8b1d89 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:15 devstack sudo[100929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdaea41b-1ffc-483b-92bb-6eca0804462f -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.111c3aa4-7a2b-4361-be68-60d3fe8b1d89 Sep 05 05:12:15 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:15 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fe620842-92e2-4e79-bd9a-b52f5a5873bc tempest-VolumesActionsTest-1530445118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f" returned: 0 in 0.398s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fe620842-92e2-4e79-bd9a-b52f5a5873bc tempest-VolumesActionsTest-1530445118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:15 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f Sep 05 05:12:15 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:15 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a14fe93a-9f99-4bb0-bfda-f897feec1a3f tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdaea41b-1ffc-483b-92bb-6eca0804462f -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.111c3aa4-7a2b-4361-be68-60d3fe8b1d89" returned: 0 in 0.322s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:15 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-a14fe93a-9f99-4bb0-bfda-f897feec1a3f tempest-VolumesSnapshotTestJSON-1994781731 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.111c3aa4-7a2b-4361-be68-60d3fe8b1d89 is being set with open permissions: ugo+rw Sep 05 05:12:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a14fe93a-9f99-4bb0-bfda-f897feec1a3f tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.111c3aa4-7a2b-4361-be68-60d3fe8b1d89 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:15 devstack sudo[100939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.111c3aa4-7a2b-4361-be68-60d3fe8b1d89 Sep 05 05:12:15 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:15 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fe620842-92e2-4e79-bd9a-b52f5a5873bc tempest-VolumesActionsTest-1530445118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-39594f6f-d41b-4554-92a6-0fab8b4f7d3f" returned: 0 in 0.311s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fe620842-92e2-4e79-bd9a-b52f5a5873bc tempest-VolumesActionsTest-1530445118 None] Lock "cinder-quobyte-39594f6f-d41b-4554-92a6-0fab8b4f7d3f" released by "delete_volume" :: held 0.756s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:15 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a14fe93a-9f99-4bb0-bfda-f897feec1a3f tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.111c3aa4-7a2b-4361-be68-60d3fe8b1d89" returned: 0 in 0.286s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a14fe93a-9f99-4bb0-bfda-f897feec1a3f tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:16 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-fe620842-92e2-4e79-bd9a-b52f5a5873bc tempest-VolumesActionsTest-1530445118 None] Created reservations ['0b111ce5-8ddc-486d-8d4d-0282c726123c', '395841c6-ef83-47fc-9c32-140aee4b6569', '30cd24e3-67d9-4c10-9550-db4c2d2129c5', '40d344e6-0460-4bbb-899d-8e3decdca9ff'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:12:16 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.info Sep 05 05:12:16 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fe620842-92e2-4e79-bd9a-b52f5a5873bc tempest-VolumesActionsTest-1530445118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fe620842-92e2-4e79-bd9a-b52f5a5873bc tempest-VolumesActionsTest-1530445118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:16 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-fe620842-92e2-4e79-bd9a-b52f5a5873bc tempest-VolumesActionsTest-1530445118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:16 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-fe620842-92e2-4e79-bd9a-b52f5a5873bc tempest-VolumesActionsTest-1530445118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fe620842-92e2-4e79-bd9a-b52f5a5873bc tempest-VolumesActionsTest-1530445118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fe620842-92e2-4e79-bd9a-b52f5a5873bc tempest-VolumesActionsTest-1530445118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:16 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:12:16 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:16 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:16 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fe620842-92e2-4e79-bd9a-b52f5a5873bc tempest-VolumesActionsTest-1530445118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.381s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:16 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-fe620842-92e2-4e79-bd9a-b52f5a5873bc tempest-VolumesActionsTest-1530445118 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:12:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a14fe93a-9f99-4bb0-bfda-f897feec1a3f tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.info" returned: 0 in 0.534s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:16 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-a14fe93a-9f99-4bb0-bfda-f897feec1a3f tempest-VolumesSnapshotTestJSON-1994781731 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.info is being set with open permissions: ugo+rw Sep 05 05:12:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a14fe93a-9f99-4bb0-bfda-f897feec1a3f tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:16 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-fe620842-92e2-4e79-bd9a-b52f5a5873bc tempest-VolumesActionsTest-1530445118 None] Deleted volume successfully. Sep 05 05:12:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fe620842-92e2-4e79-bd9a-b52f5a5873bc tempest-VolumesActionsTest-1530445118 None] Lock "cinder-39594f6f-d41b-4554-92a6-0fab8b4f7d3f-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:16 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.info Sep 05 05:12:16 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:16 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a14fe93a-9f99-4bb0-bfda-f897feec1a3f tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.info" returned: 0 in 0.306s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a14fe93a-9f99-4bb0-bfda-f897feec1a3f tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.475s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b73042a7-6a73-441f-a9f5-17dad2358fdc tempest-CinderUnicodeTest-65203055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.859s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:16 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-b73042a7-6a73-441f-a9f5-17dad2358fdc tempest-CinderUnicodeTest-65203055 None] Creating offline snapshot 2f71e220-e116-486f-a49f-258ddd4aa6fb of volume eb85d009-764c-4df9-876e-7bde4fdb4a7e {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:12:16 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfe7fab-38e4-4982-a500-5b66f86aeb48]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b73042a7-6a73-441f-a9f5-17dad2358fdc tempest-CinderUnicodeTest-65203055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:16 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-a14fe93a-9f99-4bb0-bfda-f897feec1a3f tempest-VolumesSnapshotTestJSON-1994781731 None] Create snapshot completed successfully Sep 05 05:12:17 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e Sep 05 05:12:17 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:17 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b73042a7-6a73-441f-a9f5-17dad2358fdc tempest-CinderUnicodeTest-65203055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e" returned: 0 in 0.466s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b73042a7-6a73-441f-a9f5-17dad2358fdc tempest-CinderUnicodeTest-65203055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.2f71e220-e116-486f-a49f-258ddd4aa6fb 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:17 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.2f71e220-e116-486f-a49f-258ddd4aa6fb 1G Sep 05 05:12:17 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:17 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b73042a7-6a73-441f-a9f5-17dad2358fdc tempest-CinderUnicodeTest-65203055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.2f71e220-e116-486f-a49f-258ddd4aa6fb 1G" returned: 0 in 0.428s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b73042a7-6a73-441f-a9f5-17dad2358fdc tempest-CinderUnicodeTest-65203055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.2f71e220-e116-486f-a49f-258ddd4aa6fb {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:17 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.2f71e220-e116-486f-a49f-258ddd4aa6fb Sep 05 05:12:17 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3d5c3812-0622-41a0-9095-2b415c6dce16 tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "cinder-111c3aa4-7a2b-4361-be68-60d3fe8b1d89-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3d5c3812-0622-41a0-9095-2b415c6dce16 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-111c3aa4-7a2b-4361-be68-60d3fe8b1d89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3d5c3812-0622-41a0-9095-2b415c6dce16 tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "cinder-quobyte-bdaea41b-1ffc-483b-92bb-6eca0804462f" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3d5c3812-0622-41a0-9095-2b415c6dce16 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-bdaea41b-1ffc-483b-92bb-6eca0804462f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3d5c3812-0622-41a0-9095-2b415c6dce16 tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "cinder-quobyte-111c3aa4-7a2b-4361-be68-60d3fe8b1d89" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3d5c3812-0622-41a0-9095-2b415c6dce16 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-111c3aa4-7a2b-4361-be68-60d3fe8b1d89" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:18 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-3d5c3812-0622-41a0-9095-2b415c6dce16 tempest-VolumesSnapshotTestJSON-1994781731 None] Deleting offline snapshot 111c3aa4-7a2b-4361-be68-60d3fe8b1d89 of volume bdaea41b-1ffc-483b-92bb-6eca0804462f {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:12:18 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:18 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-3d5c3812-0622-41a0-9095-2b415c6dce16 tempest-VolumesSnapshotTestJSON-1994781731 None] snapshot_file for this snap is: volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.111c3aa4-7a2b-4361-be68-60d3fe8b1d89 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:12:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b73042a7-6a73-441f-a9f5-17dad2358fdc tempest-CinderUnicodeTest-65203055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.2f71e220-e116-486f-a49f-258ddd4aa6fb" returned: 0 in 0.485s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:18 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-b73042a7-6a73-441f-a9f5-17dad2358fdc tempest-CinderUnicodeTest-65203055 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.2f71e220-e116-486f-a49f-258ddd4aa6fb is being set with open permissions: ugo+rw Sep 05 05:12:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b73042a7-6a73-441f-a9f5-17dad2358fdc tempest-CinderUnicodeTest-65203055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.2f71e220-e116-486f-a49f-258ddd4aa6fb {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:18 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[45de4f6a-41db-46c2-ada3-fe15499aca3f]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d5c3812-0622-41a0-9095-2b415c6dce16 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.111c3aa4-7a2b-4361-be68-60d3fe8b1d89 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:18 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.2f71e220-e116-486f-a49f-258ddd4aa6fb Sep 05 05:12:18 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:18 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.111c3aa4-7a2b-4361-be68-60d3fe8b1d89 Sep 05 05:12:18 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:18 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b73042a7-6a73-441f-a9f5-17dad2358fdc tempest-CinderUnicodeTest-65203055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.2f71e220-e116-486f-a49f-258ddd4aa6fb" returned: 0 in 0.305s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b73042a7-6a73-441f-a9f5-17dad2358fdc tempest-CinderUnicodeTest-65203055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:18 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.info Sep 05 05:12:18 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:18 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d5c3812-0622-41a0-9095-2b415c6dce16 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.111c3aa4-7a2b-4361-be68-60d3fe8b1d89" returned: 0 in 0.447s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:18 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-3d5c3812-0622-41a0-9095-2b415c6dce16 tempest-VolumesSnapshotTestJSON-1994781731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdaea41b-1ffc-483b-92bb-6eca0804462f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:12:18 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[380b2573-b16b-4bb5-81f4-7500b014257c]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d5c3812-0622-41a0-9095-2b415c6dce16 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:18 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f Sep 05 05:12:18 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:18 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b73042a7-6a73-441f-a9f5-17dad2358fdc tempest-CinderUnicodeTest-65203055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.info" returned: 0 in 0.372s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:18 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-b73042a7-6a73-441f-a9f5-17dad2358fdc tempest-CinderUnicodeTest-65203055 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.info is being set with open permissions: ugo+rw Sep 05 05:12:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b73042a7-6a73-441f-a9f5-17dad2358fdc tempest-CinderUnicodeTest-65203055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:19 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.info Sep 05 05:12:19 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:19 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d5c3812-0622-41a0-9095-2b415c6dce16 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f" returned: 0 in 0.498s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d5c3812-0622-41a0-9095-2b415c6dce16 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.111c3aa4-7a2b-4361-be68-60d3fe8b1d89 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:19 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.111c3aa4-7a2b-4361-be68-60d3fe8b1d89 Sep 05 05:12:19 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:19 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b73042a7-6a73-441f-a9f5-17dad2358fdc tempest-CinderUnicodeTest-65203055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.info" returned: 0 in 0.376s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b73042a7-6a73-441f-a9f5-17dad2358fdc tempest-CinderUnicodeTest-65203055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.572s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:19 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-b73042a7-6a73-441f-a9f5-17dad2358fdc tempest-CinderUnicodeTest-65203055 None] Create snapshot completed successfully Sep 05 05:12:19 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d5c3812-0622-41a0-9095-2b415c6dce16 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.111c3aa4-7a2b-4361-be68-60d3fe8b1d89" returned: 0 in 0.449s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d5c3812-0622-41a0-9095-2b415c6dce16 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.111c3aa4-7a2b-4361-be68-60d3fe8b1d89 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:19 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.111c3aa4-7a2b-4361-be68-60d3fe8b1d89 Sep 05 05:12:19 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:19 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d5c3812-0622-41a0-9095-2b415c6dce16 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f.111c3aa4-7a2b-4361-be68-60d3fe8b1d89" returned: 0 in 0.264s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:20 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3d5c3812-0622-41a0-9095-2b415c6dce16 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-111c3aa4-7a2b-4361-be68-60d3fe8b1d89" released by "_delete_snapshot" :: held 1.806s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:20 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3d5c3812-0622-41a0-9095-2b415c6dce16 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-bdaea41b-1ffc-483b-92bb-6eca0804462f" released by "delete_snapshot" :: held 1.833s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:20 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-3d5c3812-0622-41a0-9095-2b415c6dce16 tempest-VolumesSnapshotTestJSON-1994781731 None] Created reservations ['df6f6a2a-0b4b-4e54-8533-7c339c4e236d', '5c778f27-5b10-4746-a871-19b519dd15e4', 'eae51ffa-7f2c-45ac-b835-760317df8b14', 'bb9f6555-8934-4a82-8952-5ea1004303ec'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:12:20 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-3d5c3812-0622-41a0-9095-2b415c6dce16 tempest-VolumesSnapshotTestJSON-1994781731 None] Delete snapshot completed successfully. Sep 05 05:12:20 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3d5c3812-0622-41a0-9095-2b415c6dce16 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-111c3aa4-7a2b-4361-be68-60d3fe8b1d89-delete_snapshot" released by "delete_snapshot" :: held 2.107s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:20 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7653f438-b91c-4702-8441-33c8db0a0e58 tempest-CinderUnicodeTest-65203055 None] Acquiring lock "cinder-2f71e220-e116-486f-a49f-258ddd4aa6fb-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:20 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7653f438-b91c-4702-8441-33c8db0a0e58 tempest-CinderUnicodeTest-65203055 None] Lock "cinder-2f71e220-e116-486f-a49f-258ddd4aa6fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:20 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7653f438-b91c-4702-8441-33c8db0a0e58 tempest-CinderUnicodeTest-65203055 None] Acquiring lock "cinder-quobyte-eb85d009-764c-4df9-876e-7bde4fdb4a7e" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:20 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7653f438-b91c-4702-8441-33c8db0a0e58 tempest-CinderUnicodeTest-65203055 None] Lock "cinder-quobyte-eb85d009-764c-4df9-876e-7bde4fdb4a7e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:20 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7653f438-b91c-4702-8441-33c8db0a0e58 tempest-CinderUnicodeTest-65203055 None] Acquiring lock "cinder-quobyte-2f71e220-e116-486f-a49f-258ddd4aa6fb" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:20 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7653f438-b91c-4702-8441-33c8db0a0e58 tempest-CinderUnicodeTest-65203055 None] Lock "cinder-quobyte-2f71e220-e116-486f-a49f-258ddd4aa6fb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-7653f438-b91c-4702-8441-33c8db0a0e58 tempest-CinderUnicodeTest-65203055 None] Deleting offline snapshot 2f71e220-e116-486f-a49f-258ddd4aa6fb of volume eb85d009-764c-4df9-876e-7bde4fdb4a7e {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:12:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-7653f438-b91c-4702-8441-33c8db0a0e58 tempest-CinderUnicodeTest-65203055 None] snapshot_file for this snap is: volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.2f71e220-e116-486f-a49f-258ddd4aa6fb {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:12:20 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f466252-024d-4af9-9c2d-7afb61552f32]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7653f438-b91c-4702-8441-33c8db0a0e58 tempest-CinderUnicodeTest-65203055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.2f71e220-e116-486f-a49f-258ddd4aa6fb {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:20 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.2f71e220-e116-486f-a49f-258ddd4aa6fb Sep 05 05:12:20 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:21 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7653f438-b91c-4702-8441-33c8db0a0e58 tempest-CinderUnicodeTest-65203055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.2f71e220-e116-486f-a49f-258ddd4aa6fb" returned: 0 in 0.553s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-7653f438-b91c-4702-8441-33c8db0a0e58 tempest-CinderUnicodeTest-65203055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4437f233-5697-42a2-be48-69b28f0ef0fa]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7653f438-b91c-4702-8441-33c8db0a0e58 tempest-CinderUnicodeTest-65203055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Flow 'volume_create_manager' (9ac1a28a-21e4-4f71-8ab3-de6918c40754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b2ff9e5-e9ff-4481-b7fe-321ddad6e425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b2ff9e5-e9ff-4481-b7fe-321ddad6e425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1135575327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e53fe1e-3ed7-4055-b3a9-76acf457dadb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85443d45c6f6476db28bd21fe4c3b2ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:12:21Z,use_quota=True,user_id='036aaf35f79d4d9b8f12aa9de9e08d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd37d2d8-72f0-425b-b321-736e82b19dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd37d2d8-72f0-425b-b321-736e82b19dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c76f27-6478-4d68-8059-a25e76bfecb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c76f27-6478-4d68-8059-a25e76bfecb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e53fe1e-3ed7-4055-b3a9-76acf457dadb', 'volume_name': 'volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4d2a8b-9e7c-4381-a98e-fd3c598f6a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4d2a8b-9e7c-4381-a98e-fd3c598f6a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5382c0-a4b3-477a-9ae0-b0035a4e107d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:21 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Volume 6e53fe1e-3ed7-4055-b3a9-76acf457dadb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb', 'volume_size': 1} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1135575327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e53fe1e-3ed7-4055-b3a9-76acf457dadb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85443d45c6f6476db28bd21fe4c3b2ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:12:21Z,use_quota=True,user_id='036aaf35f79d4d9b8f12aa9de9e08d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Creating volume 6e53fe1e-3ed7-4055-b3a9-76acf457dadb {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:12:21 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:21 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e Sep 05 05:12:21 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:21 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb 1073741824 Sep 05 05:12:21 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:21 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7653f438-b91c-4702-8441-33c8db0a0e58 tempest-CinderUnicodeTest-65203055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e" returned: 0 in 0.599s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7653f438-b91c-4702-8441-33c8db0a0e58 tempest-CinderUnicodeTest-65203055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.2f71e220-e116-486f-a49f-258ddd4aa6fb {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:21 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.2f71e220-e116-486f-a49f-258ddd4aa6fb Sep 05 05:12:21 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:21 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb 1073741824" returned: 0 in 0.574s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:21 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb Sep 05 05:12:21 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:22 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7653f438-b91c-4702-8441-33c8db0a0e58 tempest-CinderUnicodeTest-65203055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.2f71e220-e116-486f-a49f-258ddd4aa6fb" returned: 0 in 0.556s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7653f438-b91c-4702-8441-33c8db0a0e58 tempest-CinderUnicodeTest-65203055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.2f71e220-e116-486f-a49f-258ddd4aa6fb {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:22 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb" returned: 0 in 0.342s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:12:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:22 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.2f71e220-e116-486f-a49f-258ddd4aa6fb Sep 05 05:12:22 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5382c0-a4b3-477a-9ae0-b0035a4e107d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808d4901-c595-47a1-82f7-65e3c1053403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:22 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Volume volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb (6e53fe1e-3ed7-4055-b3a9-76acf457dadb): created successfully Sep 05 05:12:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808d4901-c595-47a1-82f7-65e3c1053403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Flow 'volume_create_manager' (9ac1a28a-21e4-4f71-8ab3-de6918c40754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:12:22 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-69b21c08-4011-4c7e-9b4a-ce03f1a7f4c6 tempest-VolumesSnapshotTestJSON-1994781731 None] Created volume successfully. Sep 05 05:12:22 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7653f438-b91c-4702-8441-33c8db0a0e58 tempest-CinderUnicodeTest-65203055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e.2f71e220-e116-486f-a49f-258ddd4aa6fb" returned: 0 in 0.345s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:22 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7653f438-b91c-4702-8441-33c8db0a0e58 tempest-CinderUnicodeTest-65203055 None] Lock "cinder-quobyte-2f71e220-e116-486f-a49f-258ddd4aa6fb" released by "_delete_snapshot" :: held 2.177s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:22 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7653f438-b91c-4702-8441-33c8db0a0e58 tempest-CinderUnicodeTest-65203055 None] Lock "cinder-quobyte-eb85d009-764c-4df9-876e-7bde4fdb4a7e" released by "delete_snapshot" :: held 2.206s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:22 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-7653f438-b91c-4702-8441-33c8db0a0e58 tempest-CinderUnicodeTest-65203055 None] Created reservations ['72e97b7c-9a8e-49d5-be8e-fc04d94a7d44', 'a101f853-04db-4246-b29e-24b8f326111c', '231f654b-057c-4b13-8df9-37faa5077d91', 'b66564f5-e13d-49f2-a07c-6d1428bc3b64'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:12:22 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-7653f438-b91c-4702-8441-33c8db0a0e58 tempest-CinderUnicodeTest-65203055 None] Delete snapshot completed successfully. Sep 05 05:12:22 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7653f438-b91c-4702-8441-33c8db0a0e58 tempest-CinderUnicodeTest-65203055 None] Lock "cinder-2f71e220-e116-486f-a49f-258ddd4aa6fb-delete_snapshot" released by "delete_snapshot" :: held 2.390s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8a3c820f-b28b-4e38-a1c4-81edd070d1ea tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8a3c820f-b28b-4e38-a1c4-81edd070d1ea tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-8a3c820f-b28b-4e38-a1c4-81edd070d1ea tempest-VolumesSnapshotTestJSON-1994781731 None] Creating offline snapshot cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b of volume 6e53fe1e-3ed7-4055-b3a9-76acf457dadb {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:12:23 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7159d83b-bb83-4989-8777-b184d64ff620]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8a3c820f-b28b-4e38-a1c4-81edd070d1ea tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:23 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-29ae9674-0dee-4dd5-b559-58d54442b2e8 tempest-CinderUnicodeTest-65203055 None] Acquiring lock "cinder-eb85d009-764c-4df9-876e-7bde4fdb4a7e-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:23 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-29ae9674-0dee-4dd5-b559-58d54442b2e8 tempest-CinderUnicodeTest-65203055 None] Lock "cinder-eb85d009-764c-4df9-876e-7bde4fdb4a7e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:23 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb Sep 05 05:12:23 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:23 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-29ae9674-0dee-4dd5-b559-58d54442b2e8 tempest-CinderUnicodeTest-65203055 None] Acquiring lock "cinder-quobyte-eb85d009-764c-4df9-876e-7bde4fdb4a7e" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:23 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-29ae9674-0dee-4dd5-b559-58d54442b2e8 tempest-CinderUnicodeTest-65203055 None] Lock "cinder-quobyte-eb85d009-764c-4df9-876e-7bde4fdb4a7e" acquired by "delete_volume" :: waited 0.031s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:24 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fded1f-6998-43b5-a863-876ca4dab6ce]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-29ae9674-0dee-4dd5-b559-58d54442b2e8 tempest-CinderUnicodeTest-65203055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:24 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8a3c820f-b28b-4e38-a1c4-81edd070d1ea tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb" returned: 0 in 0.548s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8a3c820f-b28b-4e38-a1c4-81edd070d1ea tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:24 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b 1G Sep 05 05:12:24 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:24 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e Sep 05 05:12:24 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:24 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-29ae9674-0dee-4dd5-b559-58d54442b2e8 tempest-CinderUnicodeTest-65203055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e" returned: 0 in 0.520s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-29ae9674-0dee-4dd5-b559-58d54442b2e8 tempest-CinderUnicodeTest-65203055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:24 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e Sep 05 05:12:24 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:24 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8a3c820f-b28b-4e38-a1c4-81edd070d1ea tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b 1G" returned: 0 in 0.673s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8a3c820f-b28b-4e38-a1c4-81edd070d1ea tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:24 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-29ae9674-0dee-4dd5-b559-58d54442b2e8 tempest-CinderUnicodeTest-65203055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-eb85d009-764c-4df9-876e-7bde4fdb4a7e" returned: 0 in 0.325s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:24 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b Sep 05 05:12:24 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:24 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-29ae9674-0dee-4dd5-b559-58d54442b2e8 tempest-CinderUnicodeTest-65203055 None] Lock "cinder-quobyte-eb85d009-764c-4df9-876e-7bde4fdb4a7e" released by "delete_volume" :: held 0.966s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:24 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-29ae9674-0dee-4dd5-b559-58d54442b2e8 tempest-CinderUnicodeTest-65203055 None] Created reservations ['f35984e4-c5d1-4760-b51c-93f04cad091b', 'ec85feed-1a54-40ca-8313-be3f17e02ca4', 'cf27f023-f946-476b-9563-bedf9f2bf98b', '40c8cbba-8f97-4a2b-ac93-564b542ae54c'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:12:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-29ae9674-0dee-4dd5-b559-58d54442b2e8 tempest-CinderUnicodeTest-65203055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-29ae9674-0dee-4dd5-b559-58d54442b2e8 tempest-CinderUnicodeTest-65203055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-29ae9674-0dee-4dd5-b559-58d54442b2e8 tempest-CinderUnicodeTest-65203055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-29ae9674-0dee-4dd5-b559-58d54442b2e8 tempest-CinderUnicodeTest-65203055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-29ae9674-0dee-4dd5-b559-58d54442b2e8 tempest-CinderUnicodeTest-65203055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-29ae9674-0dee-4dd5-b559-58d54442b2e8 tempest-CinderUnicodeTest-65203055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:25 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:12:25 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:25 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8a3c820f-b28b-4e38-a1c4-81edd070d1ea tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b" returned: 0 in 0.446s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:25 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-8a3c820f-b28b-4e38-a1c4-81edd070d1ea tempest-VolumesSnapshotTestJSON-1994781731 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b is being set with open permissions: ugo+rw Sep 05 05:12:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8a3c820f-b28b-4e38-a1c4-81edd070d1ea tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:25 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b Sep 05 05:12:25 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:25 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-29ae9674-0dee-4dd5-b559-58d54442b2e8 tempest-CinderUnicodeTest-65203055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.349s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:25 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-29ae9674-0dee-4dd5-b559-58d54442b2e8 tempest-CinderUnicodeTest-65203055 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:12:25 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-29ae9674-0dee-4dd5-b559-58d54442b2e8 tempest-CinderUnicodeTest-65203055 None] Deleted volume successfully. Sep 05 05:12:25 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-29ae9674-0dee-4dd5-b559-58d54442b2e8 tempest-CinderUnicodeTest-65203055 None] Lock "cinder-eb85d009-764c-4df9-876e-7bde4fdb4a7e-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:25 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8a3c820f-b28b-4e38-a1c4-81edd070d1ea tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b" returned: 0 in 0.291s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8a3c820f-b28b-4e38-a1c4-81edd070d1ea tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:25 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.info Sep 05 05:12:25 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:25 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8a3c820f-b28b-4e38-a1c4-81edd070d1ea tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.info" returned: 0 in 0.258s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:25 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-8a3c820f-b28b-4e38-a1c4-81edd070d1ea tempest-VolumesSnapshotTestJSON-1994781731 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.info is being set with open permissions: ugo+rw Sep 05 05:12:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8a3c820f-b28b-4e38-a1c4-81edd070d1ea tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:25 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.info Sep 05 05:12:25 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:25 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-661ddcc4-fcad-4e11-ba2f-a4cb9076a2eb tempest-CinderUnicodeTest-65203055 None] Acquiring lock "cinder-f9797b56-ea64-4962-a43e-f41806e4d958-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-661ddcc4-fcad-4e11-ba2f-a4cb9076a2eb tempest-CinderUnicodeTest-65203055 None] Lock "cinder-f9797b56-ea64-4962-a43e-f41806e4d958-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Flow 'volume_create_manager' (faa2e963-05a2-4817-bf6c-efb25b66669b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807ffe82-65ef-43d7-9e1d-bfa6d676c64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807ffe82-65ef-43d7-9e1d-bfa6d676c64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1350839376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691187f4-cd7c-4dbf-9f74-8b824ae5186d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a30a3197614c439d29d90c45671274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:12:26Z,use_quota=True,user_id='9c7cdd31fb9e4935b0bb3b413f4195f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677fd23c-3a50-497e-884e-da78a512d17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677fd23c-3a50-497e-884e-da78a512d17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62221f30-1283-42c5-82cc-cd66e5e6091a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62221f30-1283-42c5-82cc-cd66e5e6091a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '691187f4-cd7c-4dbf-9f74-8b824ae5186d', 'volume_name': 'volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:26 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3c0000-52c3-4291-8b66-42476eb6d488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3c0000-52c3-4291-8b66-42476eb6d488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f823eaa-5b58-4706-a223-58bebcd128fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:26 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Volume 691187f4-cd7c-4dbf-9f74-8b824ae5186d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d', 'volume_size': 1} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8a3c820f-b28b-4e38-a1c4-81edd070d1ea tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.info" returned: 0 in 0.280s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8a3c820f-b28b-4e38-a1c4-81edd070d1ea tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.620s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.022s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1350839376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691187f4-cd7c-4dbf-9f74-8b824ae5186d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a30a3197614c439d29d90c45671274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:12:26Z,use_quota=True,user_id='9c7cdd31fb9e4935b0bb3b413f4195f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Creating volume 691187f4-cd7c-4dbf-9f74-8b824ae5186d {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:12:26 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-661ddcc4-fcad-4e11-ba2f-a4cb9076a2eb tempest-CinderUnicodeTest-65203055 None] Acquiring lock "cinder-quobyte-f9797b56-ea64-4962-a43e-f41806e4d958" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:26 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d 1073741824 Sep 05 05:12:26 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-661ddcc4-fcad-4e11-ba2f-a4cb9076a2eb tempest-CinderUnicodeTest-65203055 None] Lock "cinder-quobyte-f9797b56-ea64-4962-a43e-f41806e4d958" acquired by "delete_volume" :: waited 0.022s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:26 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-8a3c820f-b28b-4e38-a1c4-81edd070d1ea tempest-VolumesSnapshotTestJSON-1994781731 None] Create snapshot completed successfully Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[418ad14a-379b-4c12-9474-d24a6a3709a2]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-661ddcc4-fcad-4e11-ba2f-a4cb9076a2eb tempest-CinderUnicodeTest-65203055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9797b56-ea64-4962-a43e-f41806e4d958 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:26 devstack sudo[101077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9797b56-ea64-4962-a43e-f41806e4d958 Sep 05 05:12:26 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:26 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d 1073741824" returned: 0 in 0.420s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:26 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-661ddcc4-fcad-4e11-ba2f-a4cb9076a2eb tempest-CinderUnicodeTest-65203055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9797b56-ea64-4962-a43e-f41806e4d958" returned: 0 in 0.388s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-661ddcc4-fcad-4e11-ba2f-a4cb9076a2eb tempest-CinderUnicodeTest-65203055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9797b56-ea64-4962-a43e-f41806e4d958 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:26 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9797b56-ea64-4962-a43e-f41806e4d958 Sep 05 05:12:26 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:26 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d Sep 05 05:12:26 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:26 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-661ddcc4-fcad-4e11-ba2f-a4cb9076a2eb tempest-CinderUnicodeTest-65203055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f9797b56-ea64-4962-a43e-f41806e4d958" returned: 0 in 0.270s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:26 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-661ddcc4-fcad-4e11-ba2f-a4cb9076a2eb tempest-CinderUnicodeTest-65203055 None] Lock "cinder-quobyte-f9797b56-ea64-4962-a43e-f41806e4d958" released by "delete_volume" :: held 0.713s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d" returned: 0 in 0.284s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f823eaa-5b58-4706-a223-58bebcd128fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe22fa69-6664-4cf0-b2e5-e83b3b69f7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:26 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Volume volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d (691187f4-cd7c-4dbf-9f74-8b824ae5186d): created successfully Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe22fa69-6664-4cf0-b2e5-e83b3b69f7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Flow 'volume_create_manager' (faa2e963-05a2-4817-bf6c-efb25b66669b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:12:27 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-f3259be2-691c-4cc6-9c50-7a29bdccfab3 tempest-VolumesCloneTest-114477844 None] Created volume successfully. Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-661ddcc4-fcad-4e11-ba2f-a4cb9076a2eb tempest-CinderUnicodeTest-65203055 None] Created reservations ['92dff0b0-b812-43ff-bb4f-122f1b70d2a0', 'a43ac24e-81b0-497f-91dd-892313e21bfe', 'b5e1a31b-5a2b-4f98-bf78-a67b67c20f2d', 'b747006d-f269-4070-9fc1-b6f38418d151'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-661ddcc4-fcad-4e11-ba2f-a4cb9076a2eb tempest-CinderUnicodeTest-65203055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-661ddcc4-fcad-4e11-ba2f-a4cb9076a2eb tempest-CinderUnicodeTest-65203055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-661ddcc4-fcad-4e11-ba2f-a4cb9076a2eb tempest-CinderUnicodeTest-65203055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-661ddcc4-fcad-4e11-ba2f-a4cb9076a2eb tempest-CinderUnicodeTest-65203055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-661ddcc4-fcad-4e11-ba2f-a4cb9076a2eb tempest-CinderUnicodeTest-65203055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-661ddcc4-fcad-4e11-ba2f-a4cb9076a2eb tempest-CinderUnicodeTest-65203055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:27 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:12:27 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Flow 'volume_create_manager' (371ba263-a3d8-47d2-bdce-eb3690408cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823cc564-a5fc-4749-8c58-d16a2598b758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823cc564-a5fc-4749-8c58-d16a2598b758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2079329500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b702f23d-7ffa-4c85-8b64-5965971a6197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85443d45c6f6476db28bd21fe4c3b2ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:12:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:12:27Z,use_quota=True,user_id='036aaf35f79d4d9b8f12aa9de9e08d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8266f030-e95a-4cfb-982c-11cfa277e1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:27 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8266f030-e95a-4cfb-982c-11cfa277e1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06d8154-541f-4dcf-a440-4359d043039e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06d8154-541f-4dcf-a440-4359d043039e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b702f23d-7ffa-4c85-8b64-5965971a6197', 'volume_name': 'volume-b702f23d-7ffa-4c85-8b64-5965971a6197', 'volume_size': 2, 'snapshot_id': 'cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b'}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3710fcb0-4594-4f4c-899c-e4f7ec1eb340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3710fcb0-4594-4f4c-899c-e4f7ec1eb340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (994f5eba-ee77-427b-a07c-355014e3cd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:27 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Volume b702f23d-7ffa-4c85-8b64-5965971a6197: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b702f23d-7ffa-4c85-8b64-5965971a6197', 'volume_size': 2, 'snapshot_id': 'cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b'} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-661ddcc4-fcad-4e11-ba2f-a4cb9076a2eb tempest-CinderUnicodeTest-65203055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.339s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-661ddcc4-fcad-4e11-ba2f-a4cb9076a2eb tempest-CinderUnicodeTest-65203055 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:12:27 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-661ddcc4-fcad-4e11-ba2f-a4cb9076a2eb tempest-CinderUnicodeTest-65203055 None] Deleted volume successfully. Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "cinder-quobyte-cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b-b702f23d-7ffa-4c85-8b64-5965971a6197" by "_create_volume_from_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b-b702f23d-7ffa-4c85-8b64-5965971a6197" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Creating volume b702f23d-7ffa-4c85-8b64-5965971a6197 from snapshot cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b {{(pid=89331) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "cinder-quobyte-b702f23d-7ffa-4c85-8b64-5965971a6197" by "_copy_volume_from_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-661ddcc4-fcad-4e11-ba2f-a4cb9076a2eb tempest-CinderUnicodeTest-65203055 None] Lock "cinder-f9797b56-ea64-4962-a43e-f41806e4d958-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-b702f23d-7ffa-4c85-8b64-5965971a6197" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] snapshot: cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b, volume: b702f23d-7ffa-4c85-8b64-5965971a6197, {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63b433d-99ce-4cd6-99c1-299b83d7dde8]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:27 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b Sep 05 05:12:27 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:27 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b" returned: 0 in 0.372s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfea7b4-7009-4ee8-abc3-526498b0eb29]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:28 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb Sep 05 05:12:28 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:28 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb" returned: 0 in 0.589s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 05:12:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Creating direct copy from snapshot {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 05:12:28 devstack cinder-volume[89331]: DEBUG cinder.utils [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Path /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b702f23d-7ffa-4c85-8b64-5965971a6197 not found in is_blk_device check {{(pid=89331) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 05:12:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b702f23d-7ffa-4c85-8b64-5965971a6197 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:28 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b702f23d-7ffa-4c85-8b64-5965971a6197 Sep 05 05:12:28 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:28 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:12:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Flow 'volume_create_manager' (f9cd6cf1-14a4-4a31-970e-ff84fd052a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:12:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af793b0-ba9b-4f7b-8e0a-0e4163bbdc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af793b0-ba9b-4f7b-8e0a-0e4163bbdc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1517242610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f15b1e9-2601-4169-b658-4347fdc961cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a30a3197614c439d29d90c45671274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:12:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=691187f4-cd7c-4dbf-9f74-8b824ae5186d,status='creating',terminated_at=None,updated_at=2026-09-05T03:12:29Z,use_quota=True,user_id='9c7cdd31fb9e4935b0bb3b413f4195f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f0b8ab-1f3a-4c17-93d7-a3fa6ff78041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f0b8ab-1f3a-4c17-93d7-a3fa6ff78041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782357fd-9b30-49a4-855c-310b7156057b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782357fd-9b30-49a4-855c-310b7156057b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3f15b1e9-2601-4169-b658-4347fdc961cd', 'volume_name': 'volume-3f15b1e9-2601-4169-b658-4347fdc961cd', 'volume_size': 2, 'source_volid': '691187f4-cd7c-4dbf-9f74-8b824ae5186d', 'source_volstatus': 'available'}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6b9f28-a709-4f26-8e7d-e1a09b4ec502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6b9f28-a709-4f26-8e7d-e1a09b4ec502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f7a6ea-3ee0-4e1c-9219-30122b4e558c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:29 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Volume 3f15b1e9-2601-4169-b658-4347fdc961cd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3f15b1e9-2601-4169-b658-4347fdc961cd', 'volume_size': 2, 'source_volid': '691187f4-cd7c-4dbf-9f74-8b824ae5186d', 'source_volstatus': 'available'} Sep 05 05:12:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:35 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:12:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Flow 'volume_create_manager' (05ae59cd-840f-4bec-9952-74407ab7c0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:12:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10853bae-96fe-4475-ab89-4db7c62500a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:35 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10853bae-96fe-4475-ab89-4db7c62500a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2114657060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b9c59e-33bf-401e-a23a-3e1528ac61c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d345f66f6544de3b256abdafcef27b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:12:36Z,use_quota=True,user_id='13149165d6754915bcd1a3dd2dc37c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80917166-7933-4ca0-831d-66ff59594d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80917166-7933-4ca0-831d-66ff59594d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b11b4d6-4517-4550-897b-9bbf0be27495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b11b4d6-4517-4550-897b-9bbf0be27495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6b9c59e-33bf-401e-a23a-3e1528ac61c2', 'volume_name': 'volume-f6b9c59e-33bf-401e-a23a-3e1528ac61c2', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874504b2-6329-4b72-90b2-5cf4acf2b5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874504b2-6329-4b72-90b2-5cf4acf2b5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af6fd4c-292e-4ec3-8866-376a83da1077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:35 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Volume f6b9c59e-33bf-401e-a23a-3e1528ac61c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6b9c59e-33bf-401e-a23a-3e1528ac61c2', 'volume_size': 1} Sep 05 05:12:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b702f23d-7ffa-4c85-8b64-5965971a6197" returned: 0 in 7.174s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:35 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb, size 1024.00 MB, duration 7.17 sec, destination /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b702f23d-7ffa-4c85-8b64-5965971a6197 {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:12:35 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Converted 1024.00 MB image at 142.73 MB/s Sep 05 05:12:35 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b702f23d-7ffa-4c85-8b64-5965971a6197 is being set with open permissions: ugo+rw Sep 05 05:12:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b702f23d-7ffa-4c85-8b64-5965971a6197 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:35 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b702f23d-7ffa-4c85-8b64-5965971a6197 Sep 05 05:12:35 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:35 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b702f23d-7ffa-4c85-8b64-5965971a6197" returned: 0 in 0.253s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:35 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-b702f23d-7ffa-4c85-8b64-5965971a6197" released by "_copy_volume_from_snapshot" :: held 8.487s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b-b702f23d-7ffa-4c85-8b64-5965971a6197" released by "_create_volume_from_snapshot" :: held 8.554s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.574s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.900s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:36 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Cloning volume 691187f4-cd7c-4dbf-9f74-8b824ae5186d to volume 3f15b1e9-2601-4169-b658-4347fdc961cd Sep 05 05:12:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (994f5eba-ee77-427b-a07c-355014e3cd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b702f23d-7ffa-4c85-8b64-5965971a6197', 'volume_size': 2, 'snapshot_id': 'cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b'}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6aa5c0-cb33-4613-922a-98561d376881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:36 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Creating offline snapshot 9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf of volume 691187f4-cd7c-4dbf-9f74-8b824ae5186d {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:12:36 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Volume volume-b702f23d-7ffa-4c85-8b64-5965971a6197 (b702f23d-7ffa-4c85-8b64-5965971a6197): created successfully Sep 05 05:12:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6aa5c0-cb33-4613-922a-98561d376881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Flow 'volume_create_manager' (371ba263-a3d8-47d2-bdce-eb3690408cf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:12:36 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1caaaf-9f58-4a42-9932-d5eb2addcfb3]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:36 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-13524926-e24e-496c-9c27-4faf395e73fc tempest-VolumesSnapshotTestJSON-1994781731 None] Created volume successfully. Sep 05 05:12:36 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d Sep 05 05:12:36 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:36 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d" returned: 0 in 0.379s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:36 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf 1G Sep 05 05:12:36 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7837e7f7-ca08-4b19-9a57-039b4a0470e1 tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "cinder-b702f23d-7ffa-4c85-8b64-5965971a6197-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7837e7f7-ca08-4b19-9a57-039b4a0470e1 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-b702f23d-7ffa-4c85-8b64-5965971a6197-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7837e7f7-ca08-4b19-9a57-039b4a0470e1 tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "cinder-quobyte-b702f23d-7ffa-4c85-8b64-5965971a6197" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7837e7f7-ca08-4b19-9a57-039b4a0470e1 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-b702f23d-7ffa-4c85-8b64-5965971a6197" acquired by "delete_volume" :: waited 0.031s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:36 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8953bb58-5271-4af6-804d-b9949f72df4d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7837e7f7-ca08-4b19-9a57-039b4a0470e1 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b702f23d-7ffa-4c85-8b64-5965971a6197 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:36 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf 1G" returned: 0 in 0.478s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:36 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b702f23d-7ffa-4c85-8b64-5965971a6197 Sep 05 05:12:36 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:36 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf Sep 05 05:12:36 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:37 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7837e7f7-ca08-4b19-9a57-039b4a0470e1 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b702f23d-7ffa-4c85-8b64-5965971a6197" returned: 0 in 0.381s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7837e7f7-ca08-4b19-9a57-039b4a0470e1 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b702f23d-7ffa-4c85-8b64-5965971a6197 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:37 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b702f23d-7ffa-4c85-8b64-5965971a6197 Sep 05 05:12:37 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:37 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf" returned: 0 in 0.346s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:37 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf is being set with open permissions: ugo+rw Sep 05 05:12:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:37 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf Sep 05 05:12:37 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:37 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7837e7f7-ca08-4b19-9a57-039b4a0470e1 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b702f23d-7ffa-4c85-8b64-5965971a6197" returned: 0 in 0.300s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7837e7f7-ca08-4b19-9a57-039b4a0470e1 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-b702f23d-7ffa-4c85-8b64-5965971a6197" released by "delete_volume" :: held 0.729s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:37 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf" returned: 0 in 0.277s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:37 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-7837e7f7-ca08-4b19-9a57-039b4a0470e1 tempest-VolumesSnapshotTestJSON-1994781731 None] Created reservations ['72cd1ca2-d918-451e-9d92-582a896044ae', '19fdc744-bbd0-4d0f-aeae-b72f65641baf', 'a4a4101e-3f70-40a9-8250-8dfbea1e66ae', 'dfdc7f12-5a89-4c26-bcde-36f2e4d9304a'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:12:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:37 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.info Sep 05 05:12:37 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7837e7f7-ca08-4b19-9a57-039b4a0470e1 tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7837e7f7-ca08-4b19-9a57-039b4a0470e1 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:37 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7837e7f7-ca08-4b19-9a57-039b4a0470e1 tempest-VolumesSnapshotTestJSON-1994781731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:37 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7837e7f7-ca08-4b19-9a57-039b4a0470e1 tempest-VolumesSnapshotTestJSON-1994781731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7837e7f7-ca08-4b19-9a57-039b4a0470e1 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7837e7f7-ca08-4b19-9a57-039b4a0470e1 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:37 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:12:37 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:37 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.info" returned: 0 in 0.264s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:37 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.info is being set with open permissions: ugo+rw Sep 05 05:12:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:37 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.info Sep 05 05:12:37 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:37 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7837e7f7-ca08-4b19-9a57-039b4a0470e1 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.282s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:37 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-7837e7f7-ca08-4b19-9a57-039b4a0470e1 tempest-VolumesSnapshotTestJSON-1994781731 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:12:38 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-7837e7f7-ca08-4b19-9a57-039b4a0470e1 tempest-VolumesSnapshotTestJSON-1994781731 None] Deleted volume successfully. Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-94ed8e8f-0511-4732-926a-35144867f133 tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "cinder-cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7837e7f7-ca08-4b19-9a57-039b4a0470e1 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-b702f23d-7ffa-4c85-8b64-5965971a6197-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-94ed8e8f-0511-4732-926a-35144867f133 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-94ed8e8f-0511-4732-926a-35144867f133 tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "cinder-quobyte-6e53fe1e-3ed7-4055-b3a9-76acf457dadb" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-94ed8e8f-0511-4732-926a-35144867f133 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-6e53fe1e-3ed7-4055-b3a9-76acf457dadb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-94ed8e8f-0511-4732-926a-35144867f133 tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "cinder-quobyte-cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-94ed8e8f-0511-4732-926a-35144867f133 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-94ed8e8f-0511-4732-926a-35144867f133 tempest-VolumesSnapshotTestJSON-1994781731 None] Deleting offline snapshot cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b of volume 6e53fe1e-3ed7-4055-b3a9-76acf457dadb {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-94ed8e8f-0511-4732-926a-35144867f133 tempest-VolumesSnapshotTestJSON-1994781731 None] snapshot_file for this snap is: volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a1d823-4b61-4a6b-a2b6-8481ed0f2879]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-94ed8e8f-0511-4732-926a-35144867f133 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:38 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.info" returned: 0 in 0.320s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Acquiring lock "cinder-quobyte-3f15b1e9-2601-4169-b658-4347fdc961cd" by "_copy_volume_from_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Lock "cinder-quobyte-3f15b1e9-2601-4169-b658-4347fdc961cd" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] snapshot: 9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf, volume: 3f15b1e9-2601-4169-b658-4347fdc961cd, {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5660cb89-cab9-4f9a-b4cd-1be25e5e501d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:38 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b Sep 05 05:12:38 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:38 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf Sep 05 05:12:38 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:38 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-94ed8e8f-0511-4732-926a-35144867f133 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b" returned: 0 in 0.408s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-94ed8e8f-0511-4732-926a-35144867f133 tempest-VolumesSnapshotTestJSON-1994781731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26126f4-9936-4373-9f45-f49d9f2236ce]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-94ed8e8f-0511-4732-926a-35144867f133 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:38 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf" returned: 0 in 0.397s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e922cbf4-5c02-4308-aa0c-04ab1297fbf8]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:38 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb Sep 05 05:12:38 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:38 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d Sep 05 05:12:38 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:39 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d" returned: 0 in 0.389s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 05:12:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Creating direct copy from snapshot {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 05:12:39 devstack cinder-volume[89331]: DEBUG cinder.utils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Path /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3f15b1e9-2601-4169-b658-4347fdc961cd not found in is_blk_device check {{(pid=89331) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 05:12:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3f15b1e9-2601-4169-b658-4347fdc961cd {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:39 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3f15b1e9-2601-4169-b658-4347fdc961cd Sep 05 05:12:39 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:39 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-94ed8e8f-0511-4732-926a-35144867f133 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb" returned: 0 in 0.604s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-94ed8e8f-0511-4732-926a-35144867f133 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:39 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b Sep 05 05:12:39 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:39 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-94ed8e8f-0511-4732-926a-35144867f133 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b" returned: 0 in 0.554s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-94ed8e8f-0511-4732-926a-35144867f133 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:39 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b Sep 05 05:12:39 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:40 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-94ed8e8f-0511-4732-926a-35144867f133 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb.cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b" returned: 0 in 0.705s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:40 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-94ed8e8f-0511-4732-926a-35144867f133 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b" released by "_delete_snapshot" :: held 2.548s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:40 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-94ed8e8f-0511-4732-926a-35144867f133 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-6e53fe1e-3ed7-4055-b3a9-76acf457dadb" released by "delete_snapshot" :: held 2.598s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:40 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-94ed8e8f-0511-4732-926a-35144867f133 tempest-VolumesSnapshotTestJSON-1994781731 None] Created reservations ['b9f27444-97aa-408b-aad0-7b02928ca5bd', 'a768a165-fd4b-479a-9165-e7d1995e8f14', '83fd13a0-c029-4dcb-adbe-55dad5f34693', '4dac3f47-4dc2-4c7f-8e4d-1b94290c4412'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:12:41 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-94ed8e8f-0511-4732-926a-35144867f133 tempest-VolumesSnapshotTestJSON-1994781731 None] Delete snapshot completed successfully. Sep 05 05:12:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-94ed8e8f-0511-4732-926a-35144867f133 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-cfb43d85-cb1e-4b06-88e0-5a2bdcf6982b-delete_snapshot" released by "delete_snapshot" :: held 3.020s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4702bdd1-cba8-428e-b5e6-a9410a51042c tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "cinder-6e53fe1e-3ed7-4055-b3a9-76acf457dadb-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4702bdd1-cba8-428e-b5e6-a9410a51042c tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-6e53fe1e-3ed7-4055-b3a9-76acf457dadb-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4702bdd1-cba8-428e-b5e6-a9410a51042c tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "cinder-quobyte-6e53fe1e-3ed7-4055-b3a9-76acf457dadb" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4702bdd1-cba8-428e-b5e6-a9410a51042c tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-6e53fe1e-3ed7-4055-b3a9-76acf457dadb" acquired by "delete_volume" :: waited 0.051s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:42 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9953639f-d978-4071-8a98-b30cc1121bb2]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4702bdd1-cba8-428e-b5e6-a9410a51042c tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:42 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb Sep 05 05:12:42 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:43 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4702bdd1-cba8-428e-b5e6-a9410a51042c tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb" returned: 0 in 1.017s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4702bdd1-cba8-428e-b5e6-a9410a51042c tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:43 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb Sep 05 05:12:43 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:43 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4702bdd1-cba8-428e-b5e6-a9410a51042c tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6e53fe1e-3ed7-4055-b3a9-76acf457dadb" returned: 0 in 0.784s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:43 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4702bdd1-cba8-428e-b5e6-a9410a51042c tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-6e53fe1e-3ed7-4055-b3a9-76acf457dadb" released by "delete_volume" :: held 1.990s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:44 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-4702bdd1-cba8-428e-b5e6-a9410a51042c tempest-VolumesSnapshotTestJSON-1994781731 None] Created reservations ['13897142-b001-4822-a106-6dc0172a8d89', '75166058-1d07-4d8e-a32d-c73586bcc55d', '0acca057-d39a-4012-8821-bcf5ee0b794e', '109ca7b0-dcc3-4fd2-b6d3-a9cc68b0c713'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:12:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4702bdd1-cba8-428e-b5e6-a9410a51042c tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4702bdd1-cba8-428e-b5e6-a9410a51042c tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:44 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4702bdd1-cba8-428e-b5e6-a9410a51042c tempest-VolumesSnapshotTestJSON-1994781731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:44 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4702bdd1-cba8-428e-b5e6-a9410a51042c tempest-VolumesSnapshotTestJSON-1994781731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4702bdd1-cba8-428e-b5e6-a9410a51042c tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4702bdd1-cba8-428e-b5e6-a9410a51042c tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:44 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:12:44 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:44 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4702bdd1-cba8-428e-b5e6-a9410a51042c tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.399s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:44 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-4702bdd1-cba8-428e-b5e6-a9410a51042c tempest-VolumesSnapshotTestJSON-1994781731 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:12:44 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-4702bdd1-cba8-428e-b5e6-a9410a51042c tempest-VolumesSnapshotTestJSON-1994781731 None] Deleted volume successfully. Sep 05 05:12:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4702bdd1-cba8-428e-b5e6-a9410a51042c tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-6e53fe1e-3ed7-4055-b3a9-76acf457dadb-delete_volume" released by "delete_volume" :: held 3.056s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:45 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3f15b1e9-2601-4169-b658-4347fdc961cd" returned: 0 in 6.067s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3f15b1e9-2601-4169-b658-4347fdc961cd {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:12:45 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Converted 1024.00 MB image at 168.74 MB/s Sep 05 05:12:45 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3f15b1e9-2601-4169-b658-4347fdc961cd is being set with open permissions: ugo+rw Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3f15b1e9-2601-4169-b658-4347fdc961cd {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:45 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3f15b1e9-2601-4169-b658-4347fdc961cd Sep 05 05:12:45 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:45 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3f15b1e9-2601-4169-b658-4347fdc961cd" returned: 0 in 0.254s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Lock "cinder-quobyte-3f15b1e9-2601-4169-b658-4347fdc961cd" released by "_copy_volume_from_snapshot" :: held 7.178s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Acquiring lock "cinder-quobyte-9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Lock "cinder-quobyte-9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Deleting offline snapshot 9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf of volume 691187f4-cd7c-4dbf-9f74-8b824ae5186d {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] snapshot_file for this snap is: volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4ab9f0-6e95-4308-bc6f-a72d51847c13]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:45 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf Sep 05 05:12:45 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:12:45 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Flow 'volume_create_manager' (0f80c7da-f906-4597-ad7f-0043983ba970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66c824a-4122-40f8-ad86-de4b4d8cc565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf" returned: 0 in 0.404s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66c824a-4122-40f8-ad86-de4b4d8cc565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1969709574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c15a55-61f4-4a91-8e3b-4734a8c20e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85443d45c6f6476db28bd21fe4c3b2ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:12:46Z,use_quota=True,user_id='036aaf35f79d4d9b8f12aa9de9e08d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a255032-6494-47ed-ab97-6c185be435f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a255032-6494-47ed-ab97-6c185be435f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb7d377d-b1dd-449b-90c3-26685f01eb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb7d377d-b1dd-449b-90c3-26685f01eb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2c15a55-61f4-4a91-8e3b-4734a8c20e75', 'volume_name': 'volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72134dcd-a3e5-4474-bc49-72693e105e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72134dcd-a3e5-4474-bc49-72693e105e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d6ffe5-c58f-45fa-9f5f-e995d3eca347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:45 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Volume a2c15a55-61f4-4a91-8e3b-4734a8c20e75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75', 'volume_size': 1} Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a2feec-dd6f-4423-a42d-4a93ddf57314]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:46 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d Sep 05 05:12:46 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:46 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d" returned: 0 in 0.535s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:46 devstack sudo[101300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf Sep 05 05:12:46 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:46 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf" returned: 0 in 0.325s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:46 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf Sep 05 05:12:46 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:47 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d.9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf" returned: 0 in 0.248s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Lock "cinder-quobyte-9e9086a4-23b1-4b3c-95b8-9ee6bfbb22bf" released by "_delete_snapshot" :: held 1.640s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.110s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.423s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2114657060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b9c59e-33bf-401e-a23a-3e1528ac61c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d345f66f6544de3b256abdafcef27b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:12:36Z,use_quota=True,user_id='13149165d6754915bcd1a3dd2dc37c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Creating volume f6b9c59e-33bf-401e-a23a-3e1528ac61c2 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:12:47 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f6b9c59e-33bf-401e-a23a-3e1528ac61c2 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:47 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f6b9c59e-33bf-401e-a23a-3e1528ac61c2 1073741824 Sep 05 05:12:47 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f7a6ea-3ee0-4e1c-9219-30122b4e558c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f15b1e9-2601-4169-b658-4347fdc961cd', 'volume_size': 2, 'source_volid': '691187f4-cd7c-4dbf-9f74-8b824ae5186d', 'source_volstatus': 'available'}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8275d4f9-9a08-4d80-b69b-de3c9eac1c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:47 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Volume volume-3f15b1e9-2601-4169-b658-4347fdc961cd (3f15b1e9-2601-4169-b658-4347fdc961cd): created successfully Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8275d4f9-9a08-4d80-b69b-de3c9eac1c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Flow 'volume_create_manager' (f9cd6cf1-14a4-4a31-970e-ff84fd052a78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:12:47 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-31450f69-224f-4245-9f2d-a4e6429c106a tempest-VolumesCloneTest-114477844 None] Created volume successfully. Sep 05 05:12:47 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f6b9c59e-33bf-401e-a23a-3e1528ac61c2 1073741824" returned: 0 in 0.399s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f6b9c59e-33bf-401e-a23a-3e1528ac61c2 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:47 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f6b9c59e-33bf-401e-a23a-3e1528ac61c2 Sep 05 05:12:47 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:47 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f6b9c59e-33bf-401e-a23a-3e1528ac61c2" returned: 0 in 0.236s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.859s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1969709574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c15a55-61f4-4a91-8e3b-4734a8c20e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85443d45c6f6476db28bd21fe4c3b2ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:12:46Z,use_quota=True,user_id='036aaf35f79d4d9b8f12aa9de9e08d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Creating volume a2c15a55-61f4-4a91-8e3b-4734a8c20e75 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:12:47 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af6fd4c-292e-4ec3-8866-376a83da1077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6b9c59e-33bf-401e-a23a-3e1528ac61c2', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:47 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75 1073741824 Sep 05 05:12:47 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c070e327-b440-4292-8b2f-4743a6f0b915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:47 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Volume volume-f6b9c59e-33bf-401e-a23a-3e1528ac61c2 (f6b9c59e-33bf-401e-a23a-3e1528ac61c2): created successfully Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c070e327-b440-4292-8b2f-4743a6f0b915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Flow 'volume_create_manager' (05ae59cd-840f-4bec-9952-74407ab7c0cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:12:47 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-f2068601-d90e-415d-8dcb-ddf6e1e28ca2 tempest-ProjectReaderTests-117187296 None] Created volume successfully. Sep 05 05:12:48 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75 1073741824" returned: 0 in 0.412s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:48 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75 Sep 05 05:12:48 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-690301e2-29c9-4f1f-a77c-284d509fbb3f tempest-VolumesCloneTest-114477844 None] Acquiring lock "cinder-3f15b1e9-2601-4169-b658-4347fdc961cd-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:48 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75" returned: 0 in 0.244s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:12:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-690301e2-29c9-4f1f-a77c-284d509fbb3f tempest-VolumesCloneTest-114477844 None] Lock "cinder-3f15b1e9-2601-4169-b658-4347fdc961cd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d6ffe5-c58f-45fa-9f5f-e995d3eca347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0e95ca-aa60-4caf-bc51-db1f6eedef99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:48 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Volume volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75 (a2c15a55-61f4-4a91-8e3b-4734a8c20e75): created successfully Sep 05 05:12:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0e95ca-aa60-4caf-bc51-db1f6eedef99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Flow 'volume_create_manager' (0f80c7da-f906-4597-ad7f-0043983ba970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:12:48 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-516bca70-80a2-43a9-b5c6-50ffa31e1cc8 tempest-VolumesSnapshotTestJSON-1994781731 None] Created volume successfully. Sep 05 05:12:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-690301e2-29c9-4f1f-a77c-284d509fbb3f tempest-VolumesCloneTest-114477844 None] Acquiring lock "cinder-quobyte-3f15b1e9-2601-4169-b658-4347fdc961cd" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-690301e2-29c9-4f1f-a77c-284d509fbb3f tempest-VolumesCloneTest-114477844 None] Lock "cinder-quobyte-3f15b1e9-2601-4169-b658-4347fdc961cd" acquired by "delete_volume" :: waited 0.016s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:48 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[af783ca9-9cad-4fa0-8a29-e6868c798bbb]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-690301e2-29c9-4f1f-a77c-284d509fbb3f tempest-VolumesCloneTest-114477844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3f15b1e9-2601-4169-b658-4347fdc961cd {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:48 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3f15b1e9-2601-4169-b658-4347fdc961cd Sep 05 05:12:48 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c3669439-2d35-43cb-8229-f4e3b4fccc00 tempest-ProjectReaderTests-117187296 None] Acquiring lock "cinder-f6b9c59e-33bf-401e-a23a-3e1528ac61c2-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c3669439-2d35-43cb-8229-f4e3b4fccc00 tempest-ProjectReaderTests-117187296 None] Lock "cinder-f6b9c59e-33bf-401e-a23a-3e1528ac61c2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c3669439-2d35-43cb-8229-f4e3b4fccc00 tempest-ProjectReaderTests-117187296 None] Acquiring lock "cinder-quobyte-f6b9c59e-33bf-401e-a23a-3e1528ac61c2" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c3669439-2d35-43cb-8229-f4e3b4fccc00 tempest-ProjectReaderTests-117187296 None] Lock "cinder-quobyte-f6b9c59e-33bf-401e-a23a-3e1528ac61c2" acquired by "delete_volume" :: waited 0.023s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:48 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5a9e75-850c-417e-9e5a-d107c7c64b18]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c3669439-2d35-43cb-8229-f4e3b4fccc00 tempest-ProjectReaderTests-117187296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f6b9c59e-33bf-401e-a23a-3e1528ac61c2 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:49 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f6b9c59e-33bf-401e-a23a-3e1528ac61c2 Sep 05 05:12:49 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:49 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-690301e2-29c9-4f1f-a77c-284d509fbb3f tempest-VolumesCloneTest-114477844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3f15b1e9-2601-4169-b658-4347fdc961cd" returned: 0 in 0.409s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-690301e2-29c9-4f1f-a77c-284d509fbb3f tempest-VolumesCloneTest-114477844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3f15b1e9-2601-4169-b658-4347fdc961cd {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:49 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3f15b1e9-2601-4169-b658-4347fdc961cd Sep 05 05:12:49 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1693ddb0-67b4-43dd-a2be-93395f6aa757 tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1693ddb0-67b4-43dd-a2be-93395f6aa757 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-1693ddb0-67b4-43dd-a2be-93395f6aa757 tempest-VolumesSnapshotTestJSON-1994781731 None] Creating offline snapshot e04fcf02-b734-490b-8056-50890aa8a71c of volume a2c15a55-61f4-4a91-8e3b-4734a8c20e75 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dea5a5-f66f-45d0-b4a0-d01c1e5b134e]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1693ddb0-67b4-43dd-a2be-93395f6aa757 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:49 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c3669439-2d35-43cb-8229-f4e3b4fccc00 tempest-ProjectReaderTests-117187296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f6b9c59e-33bf-401e-a23a-3e1528ac61c2" returned: 0 in 0.436s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c3669439-2d35-43cb-8229-f4e3b4fccc00 tempest-ProjectReaderTests-117187296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f6b9c59e-33bf-401e-a23a-3e1528ac61c2 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:49 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:49 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75 Sep 05 05:12:49 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-690301e2-29c9-4f1f-a77c-284d509fbb3f tempest-VolumesCloneTest-114477844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3f15b1e9-2601-4169-b658-4347fdc961cd" returned: 0 in 0.344s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:49 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f6b9c59e-33bf-401e-a23a-3e1528ac61c2 Sep 05 05:12:49 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-690301e2-29c9-4f1f-a77c-284d509fbb3f tempest-VolumesCloneTest-114477844 None] Lock "cinder-quobyte-3f15b1e9-2601-4169-b658-4347fdc961cd" released by "delete_volume" :: held 0.797s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-690301e2-29c9-4f1f-a77c-284d509fbb3f tempest-VolumesCloneTest-114477844 None] Created reservations ['e387e61f-b773-4578-b3bd-ba1181f045f2', '64dbc53b-e06f-41c8-bf10-ef15f1a8825a', 'd2704e07-f60f-4d68-a1de-534ed95a9b18', '2c21c6e7-4f74-4c13-ac31-32b68f26afb6'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-690301e2-29c9-4f1f-a77c-284d509fbb3f tempest-VolumesCloneTest-114477844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-690301e2-29c9-4f1f-a77c-284d509fbb3f tempest-VolumesCloneTest-114477844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-690301e2-29c9-4f1f-a77c-284d509fbb3f tempest-VolumesCloneTest-114477844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-690301e2-29c9-4f1f-a77c-284d509fbb3f tempest-VolumesCloneTest-114477844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-690301e2-29c9-4f1f-a77c-284d509fbb3f tempest-VolumesCloneTest-114477844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-690301e2-29c9-4f1f-a77c-284d509fbb3f tempest-VolumesCloneTest-114477844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:49 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:12:49 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:49 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:12:49 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:49 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c3669439-2d35-43cb-8229-f4e3b4fccc00 tempest-ProjectReaderTests-117187296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f6b9c59e-33bf-401e-a23a-3e1528ac61c2" returned: 0 in 0.374s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c3669439-2d35-43cb-8229-f4e3b4fccc00 tempest-ProjectReaderTests-117187296 None] Lock "cinder-quobyte-f6b9c59e-33bf-401e-a23a-3e1528ac61c2" released by "delete_volume" :: held 0.872s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c721178a-d9be-4bdb-abb3-080c1dbc87ed tempest-VolumesCloneTest-114477844 None] Acquiring lock "cinder-691187f4-cd7c-4dbf-9f74-8b824ae5186d-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:49 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c721178a-d9be-4bdb-abb3-080c1dbc87ed tempest-VolumesCloneTest-114477844 None] Lock "cinder-691187f4-cd7c-4dbf-9f74-8b824ae5186d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1693ddb0-67b4-43dd-a2be-93395f6aa757 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75" returned: 0 in 0.618s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1693ddb0-67b4-43dd-a2be-93395f6aa757 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.e04fcf02-b734-490b-8056-50890aa8a71c 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:49 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.e04fcf02-b734-490b-8056-50890aa8a71c 1G Sep 05 05:12:49 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:49 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:49 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-690301e2-29c9-4f1f-a77c-284d509fbb3f tempest-VolumesCloneTest-114477844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.413s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-690301e2-29c9-4f1f-a77c-284d509fbb3f tempest-VolumesCloneTest-114477844 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.390s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:12:50 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-690301e2-29c9-4f1f-a77c-284d509fbb3f tempest-VolumesCloneTest-114477844 None] Deleted volume successfully. Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c721178a-d9be-4bdb-abb3-080c1dbc87ed tempest-VolumesCloneTest-114477844 None] Acquiring lock "cinder-quobyte-691187f4-cd7c-4dbf-9f74-8b824ae5186d" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-c3669439-2d35-43cb-8229-f4e3b4fccc00 tempest-ProjectReaderTests-117187296 None] Created reservations ['205a1136-d9c4-4820-b074-daf1e1d70952', '62a96311-e9a8-474d-96ba-30f9b9148453', 'b63902aa-84cf-497d-8729-7d6349a93817', '76e89fa7-2e9c-4a1b-b8c4-b17d44a3b5fd'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-690301e2-29c9-4f1f-a77c-284d509fbb3f tempest-VolumesCloneTest-114477844 None] Lock "cinder-3f15b1e9-2601-4169-b658-4347fdc961cd-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c721178a-d9be-4bdb-abb3-080c1dbc87ed tempest-VolumesCloneTest-114477844 None] Lock "cinder-quobyte-691187f4-cd7c-4dbf-9f74-8b824ae5186d" acquired by "delete_volume" :: waited 0.049s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager._thread_info {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread count: 29 {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread info: [<_MainThread(MainThread, started 139182109970560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2d6986-6aaf-4f46-a845-6ff426bb7f6b]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c721178a-d9be-4bdb-abb3-080c1dbc87ed tempest-VolumesCloneTest-114477844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c3669439-2d35-43cb-8229-f4e3b4fccc00 tempest-ProjectReaderTests-117187296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c3669439-2d35-43cb-8229-f4e3b4fccc00 tempest-ProjectReaderTests-117187296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c3669439-2d35-43cb-8229-f4e3b4fccc00 tempest-ProjectReaderTests-117187296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c3669439-2d35-43cb-8229-f4e3b4fccc00 tempest-ProjectReaderTests-117187296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c3669439-2d35-43cb-8229-f4e3b4fccc00 tempest-ProjectReaderTests-117187296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c3669439-2d35-43cb-8229-f4e3b4fccc00 tempest-ProjectReaderTests-117187296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:50 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:12:50 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:50 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d Sep 05 05:12:50 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:50 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1693ddb0-67b4-43dd-a2be-93395f6aa757 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.e04fcf02-b734-490b-8056-50890aa8a71c 1G" returned: 0 in 0.548s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1693ddb0-67b4-43dd-a2be-93395f6aa757 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.e04fcf02-b734-490b-8056-50890aa8a71c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:50 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.e04fcf02-b734-490b-8056-50890aa8a71c Sep 05 05:12:50 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:50 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c3669439-2d35-43cb-8229-f4e3b4fccc00 tempest-ProjectReaderTests-117187296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.313s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-c3669439-2d35-43cb-8229-f4e3b4fccc00 tempest-ProjectReaderTests-117187296 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:12:50 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-c3669439-2d35-43cb-8229-f4e3b4fccc00 tempest-ProjectReaderTests-117187296 None] Deleted volume successfully. Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c3669439-2d35-43cb-8229-f4e3b4fccc00 tempest-ProjectReaderTests-117187296 None] Lock "cinder-f6b9c59e-33bf-401e-a23a-3e1528ac61c2-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:50 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c721178a-d9be-4bdb-abb3-080c1dbc87ed tempest-VolumesCloneTest-114477844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d" returned: 0 in 0.516s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c721178a-d9be-4bdb-abb3-080c1dbc87ed tempest-VolumesCloneTest-114477844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:50 devstack sudo[101370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d Sep 05 05:12:50 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:50 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1693ddb0-67b4-43dd-a2be-93395f6aa757 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.e04fcf02-b734-490b-8056-50890aa8a71c" returned: 0 in 0.383s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:50 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-1693ddb0-67b4-43dd-a2be-93395f6aa757 tempest-VolumesSnapshotTestJSON-1994781731 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.e04fcf02-b734-490b-8056-50890aa8a71c is being set with open permissions: ugo+rw Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1693ddb0-67b4-43dd-a2be-93395f6aa757 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.e04fcf02-b734-490b-8056-50890aa8a71c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:50 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.e04fcf02-b734-490b-8056-50890aa8a71c Sep 05 05:12:50 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:50 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c721178a-d9be-4bdb-abb3-080c1dbc87ed tempest-VolumesCloneTest-114477844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-691187f4-cd7c-4dbf-9f74-8b824ae5186d" returned: 0 in 0.294s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:50 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c721178a-d9be-4bdb-abb3-080c1dbc87ed tempest-VolumesCloneTest-114477844 None] Lock "cinder-quobyte-691187f4-cd7c-4dbf-9f74-8b824ae5186d" released by "delete_volume" :: held 0.896s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-c721178a-d9be-4bdb-abb3-080c1dbc87ed tempest-VolumesCloneTest-114477844 None] Created reservations ['ee3bbd91-c33b-499d-a195-a714769c2f56', '8cadfaac-15b5-49fd-ba53-d38f8e7f7925', 'c5c2319a-a726-4f19-9d6c-9fecc97915e4', '2819429c-033d-4c05-86e0-92b378ba0b7c'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:12:51 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1693ddb0-67b4-43dd-a2be-93395f6aa757 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.e04fcf02-b734-490b-8056-50890aa8a71c" returned: 0 in 0.326s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c721178a-d9be-4bdb-abb3-080c1dbc87ed tempest-VolumesCloneTest-114477844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c721178a-d9be-4bdb-abb3-080c1dbc87ed tempest-VolumesCloneTest-114477844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c721178a-d9be-4bdb-abb3-080c1dbc87ed tempest-VolumesCloneTest-114477844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c721178a-d9be-4bdb-abb3-080c1dbc87ed tempest-VolumesCloneTest-114477844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c721178a-d9be-4bdb-abb3-080c1dbc87ed tempest-VolumesCloneTest-114477844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c721178a-d9be-4bdb-abb3-080c1dbc87ed tempest-VolumesCloneTest-114477844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1693ddb0-67b4-43dd-a2be-93395f6aa757 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:51 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:12:51 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:51 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.info Sep 05 05:12:51 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:51 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c721178a-d9be-4bdb-abb3-080c1dbc87ed tempest-VolumesCloneTest-114477844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.305s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-c721178a-d9be-4bdb-abb3-080c1dbc87ed tempest-VolumesCloneTest-114477844 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:12:51 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-c721178a-d9be-4bdb-abb3-080c1dbc87ed tempest-VolumesCloneTest-114477844 None] Deleted volume successfully. Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c721178a-d9be-4bdb-abb3-080c1dbc87ed tempest-VolumesCloneTest-114477844 None] Lock "cinder-691187f4-cd7c-4dbf-9f74-8b824ae5186d-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:51 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1693ddb0-67b4-43dd-a2be-93395f6aa757 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.info" returned: 0 in 0.331s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:51 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-1693ddb0-67b4-43dd-a2be-93395f6aa757 tempest-VolumesSnapshotTestJSON-1994781731 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.info is being set with open permissions: ugo+rw Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1693ddb0-67b4-43dd-a2be-93395f6aa757 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:51 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.info Sep 05 05:12:51 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Flow 'volume_create_manager' (015bf559-9e0e-4d4f-aab9-d90c9bc8a1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dabe1457-bfdb-45e3-8dba-c0bf951e7c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dabe1457-bfdb-45e3-8dba-c0bf951e7c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-651845617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb38418c-8aa8-4b97-b4fc-19886d8229c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d345f66f6544de3b256abdafcef27b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:12:52Z,use_quota=True,user_id='13149165d6754915bcd1a3dd2dc37c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ae85d3-d3b2-42e3-9623-6b7a208465ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ae85d3-d3b2-42e3-9623-6b7a208465ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012440fa-55d6-47ca-9348-3737cb64c803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012440fa-55d6-47ca-9348-3737cb64c803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb38418c-8aa8-4b97-b4fc-19886d8229c6', 'volume_name': 'volume-fb38418c-8aa8-4b97-b4fc-19886d8229c6', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:51 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99550cf4-01a7-496f-a677-a6895bd07835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99550cf4-01a7-496f-a677-a6895bd07835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80ceef3-c0cc-4d56-b48f-a45eb1d6a8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:51 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Volume fb38418c-8aa8-4b97-b4fc-19886d8229c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb38418c-8aa8-4b97-b4fc-19886d8229c6', 'volume_size': 1} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1693ddb0-67b4-43dd-a2be-93395f6aa757 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.info" returned: 0 in 0.275s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1693ddb0-67b4-43dd-a2be-93395f6aa757 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.621s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-651845617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb38418c-8aa8-4b97-b4fc-19886d8229c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d345f66f6544de3b256abdafcef27b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:12:52Z,use_quota=True,user_id='13149165d6754915bcd1a3dd2dc37c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Creating volume fb38418c-8aa8-4b97-b4fc-19886d8229c6 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:12:51 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:12:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fb38418c-8aa8-4b97-b4fc-19886d8229c6 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:51 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fb38418c-8aa8-4b97-b4fc-19886d8229c6 1073741824 Sep 05 05:12:51 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:51 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-1693ddb0-67b4-43dd-a2be-93395f6aa757 tempest-VolumesSnapshotTestJSON-1994781731 None] Create snapshot completed successfully Sep 05 05:12:52 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fb38418c-8aa8-4b97-b4fc-19886d8229c6 1073741824" returned: 0 in 0.526s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fb38418c-8aa8-4b97-b4fc-19886d8229c6 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:52 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fb38418c-8aa8-4b97-b4fc-19886d8229c6 Sep 05 05:12:52 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:52 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fb38418c-8aa8-4b97-b4fc-19886d8229c6" returned: 0 in 0.365s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:12:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80ceef3-c0cc-4d56-b48f-a45eb1d6a8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb38418c-8aa8-4b97-b4fc-19886d8229c6', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0346887-002c-4e6b-9a7d-a63232b3c77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:52 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Volume volume-fb38418c-8aa8-4b97-b4fc-19886d8229c6 (fb38418c-8aa8-4b97-b4fc-19886d8229c6): created successfully Sep 05 05:12:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0346887-002c-4e6b-9a7d-a63232b3c77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Flow 'volume_create_manager' (015bf559-9e0e-4d4f-aab9-d90c9bc8a1e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:12:52 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-872c71fc-dc3f-4eb7-abbb-325a33222976 tempest-ProjectReaderTests-117187296 None] Created volume successfully. Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Flow 'volume_create_manager' (f3118f51-ac39-4985-bb14-f46cc81fec0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6227df66-6f79-42f7-bcc7-dee08a8ee4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6227df66-6f79-42f7-bcc7-dee08a8ee4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1819359811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f68585-695a-4026-b621-98e1676c7b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85443d45c6f6476db28bd21fe4c3b2ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e04fcf02-b734-490b-8056-50890aa8a71c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:12:53Z,use_quota=True,user_id='036aaf35f79d4d9b8f12aa9de9e08d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf75140-6ca2-4679-87ac-f20392c068fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf75140-6ca2-4679-87ac-f20392c068fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a942f0f1-c632-473b-a89b-ce67f48985ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a942f0f1-c632-473b-a89b-ce67f48985ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '22f68585-695a-4026-b621-98e1676c7b61', 'volume_name': 'volume-22f68585-695a-4026-b621-98e1676c7b61', 'volume_size': 1, 'snapshot_id': 'e04fcf02-b734-490b-8056-50890aa8a71c'}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9107bdd-17e3-4042-a830-c4dacf71043b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9107bdd-17e3-4042-a830-c4dacf71043b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1841d3f9-bb5a-4046-b4e0-2b2e742d092d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:12:53 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Volume 22f68585-695a-4026-b621-98e1676c7b61: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-22f68585-695a-4026-b621-98e1676c7b61', 'volume_size': 1, 'snapshot_id': 'e04fcf02-b734-490b-8056-50890aa8a71c'} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "cinder-quobyte-e04fcf02-b734-490b-8056-50890aa8a71c-22f68585-695a-4026-b621-98e1676c7b61" by "_create_volume_from_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-e04fcf02-b734-490b-8056-50890aa8a71c-22f68585-695a-4026-b621-98e1676c7b61" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Creating volume 22f68585-695a-4026-b621-98e1676c7b61 from snapshot e04fcf02-b734-490b-8056-50890aa8a71c {{(pid=89331) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "cinder-quobyte-22f68585-695a-4026-b621-98e1676c7b61" by "_copy_volume_from_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-22f68585-695a-4026-b621-98e1676c7b61" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] snapshot: e04fcf02-b734-490b-8056-50890aa8a71c, volume: 22f68585-695a-4026-b621-98e1676c7b61, {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3cb4db-663b-4ad2-9617-7ddd3e34a87d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.e04fcf02-b734-490b-8056-50890aa8a71c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:53 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.e04fcf02-b734-490b-8056-50890aa8a71c Sep 05 05:12:53 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:53 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.e04fcf02-b734-490b-8056-50890aa8a71c" returned: 0 in 0.442s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd1cba6-39ab-4493-bc0b-11f5454da374]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:53 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75 Sep 05 05:12:53 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:53 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d4bb679a-dbc3-4c5b-8da6-6619d1bdf1f8 tempest-ProjectReaderTests-117187296 None] Acquiring lock "cinder-fb38418c-8aa8-4b97-b4fc-19886d8229c6-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d4bb679a-dbc3-4c5b-8da6-6619d1bdf1f8 tempest-ProjectReaderTests-117187296 None] Lock "cinder-fb38418c-8aa8-4b97-b4fc-19886d8229c6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d4bb679a-dbc3-4c5b-8da6-6619d1bdf1f8 tempest-ProjectReaderTests-117187296 None] Acquiring lock "cinder-quobyte-fb38418c-8aa8-4b97-b4fc-19886d8229c6" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d4bb679a-dbc3-4c5b-8da6-6619d1bdf1f8 tempest-ProjectReaderTests-117187296 None] Lock "cinder-quobyte-fb38418c-8aa8-4b97-b4fc-19886d8229c6" acquired by "delete_volume" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:54 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cdb7ad-e7e8-4229-88d6-a3d4e8039d22]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d4bb679a-dbc3-4c5b-8da6-6619d1bdf1f8 tempest-ProjectReaderTests-117187296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fb38418c-8aa8-4b97-b4fc-19886d8229c6 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:54 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75" returned: 0 in 0.501s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75 {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 05:12:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Creating direct copy from snapshot {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 05:12:54 devstack cinder-volume[89331]: DEBUG cinder.utils [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Path /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-22f68585-695a-4026-b621-98e1676c7b61 not found in is_blk_device check {{(pid=89331) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 05:12:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-22f68585-695a-4026-b621-98e1676c7b61 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:54 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-22f68585-695a-4026-b621-98e1676c7b61 Sep 05 05:12:54 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:54 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fb38418c-8aa8-4b97-b4fc-19886d8229c6 Sep 05 05:12:54 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:54 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d4bb679a-dbc3-4c5b-8da6-6619d1bdf1f8 tempest-ProjectReaderTests-117187296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fb38418c-8aa8-4b97-b4fc-19886d8229c6" returned: 0 in 0.596s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d4bb679a-dbc3-4c5b-8da6-6619d1bdf1f8 tempest-ProjectReaderTests-117187296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fb38418c-8aa8-4b97-b4fc-19886d8229c6 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:54 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fb38418c-8aa8-4b97-b4fc-19886d8229c6 Sep 05 05:12:54 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:55 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d4bb679a-dbc3-4c5b-8da6-6619d1bdf1f8 tempest-ProjectReaderTests-117187296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fb38418c-8aa8-4b97-b4fc-19886d8229c6" returned: 0 in 0.428s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:55 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d4bb679a-dbc3-4c5b-8da6-6619d1bdf1f8 tempest-ProjectReaderTests-117187296 None] Lock "cinder-quobyte-fb38418c-8aa8-4b97-b4fc-19886d8229c6" released by "delete_volume" :: held 1.167s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:55 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=91,cinder:UPDATE=138,cinder:INSERT=31,cinder:DELETE=12 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:12:55 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:UPDATE=111,cinder:SELECT=138,cinder:INSERT=30,cinder:DELETE=11 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:12:55 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-d4bb679a-dbc3-4c5b-8da6-6619d1bdf1f8 tempest-ProjectReaderTests-117187296 None] Created reservations ['dcc8ba91-2514-4375-9c5f-0e14b3960600', '93e25907-b5a8-4e5d-b7e5-cb88c93acd65', '89520c55-5c0c-4c4a-8841-275e5e710143', 'cd8375ca-4a53-4279-babc-7a92c0a33ebc'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:12:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d4bb679a-dbc3-4c5b-8da6-6619d1bdf1f8 tempest-ProjectReaderTests-117187296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:12:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d4bb679a-dbc3-4c5b-8da6-6619d1bdf1f8 tempest-ProjectReaderTests-117187296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:12:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d4bb679a-dbc3-4c5b-8da6-6619d1bdf1f8 tempest-ProjectReaderTests-117187296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:12:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d4bb679a-dbc3-4c5b-8da6-6619d1bdf1f8 tempest-ProjectReaderTests-117187296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:12:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d4bb679a-dbc3-4c5b-8da6-6619d1bdf1f8 tempest-ProjectReaderTests-117187296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:12:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d4bb679a-dbc3-4c5b-8da6-6619d1bdf1f8 tempest-ProjectReaderTests-117187296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:55 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:12:55 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:56 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-fe848e12-7d73-47c2-ad48-1a1236386bb7 req-ec753e77-6724-4485-9b45-f97ee669c403 tempest-TestMinimumBasicScenario-1051796474 None] Terminate volume connection completed successfully. Sep 05 05:12:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-fe848e12-7d73-47c2-ad48-1a1236386bb7 req-ec753e77-6724-4485-9b45-f97ee669c403 tempest-TestMinimumBasicScenario-1051796474 None] Deleting attachment 0c125722-c585-4d7b-b7b3-6d3ee30c0eb0. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:12:56 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d4bb679a-dbc3-4c5b-8da6-6619d1bdf1f8 tempest-ProjectReaderTests-117187296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.583s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:56 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-d4bb679a-dbc3-4c5b-8da6-6619d1bdf1f8 tempest-ProjectReaderTests-117187296 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:12:56 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-d4bb679a-dbc3-4c5b-8da6-6619d1bdf1f8 tempest-ProjectReaderTests-117187296 None] Deleted volume successfully. Sep 05 05:12:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d4bb679a-dbc3-4c5b-8da6-6619d1bdf1f8 tempest-ProjectReaderTests-117187296 None] Lock "cinder-fb38418c-8aa8-4b97-b4fc-19886d8229c6-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:12:58 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ad901fc0-b0b8-46ce-b056-d41f432b84db tempest-TestMinimumBasicScenario-1051796474 None] Acquiring lock "cinder-6312b723-7d69-429d-b14c-c14b17251070-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:58 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ad901fc0-b0b8-46ce-b056-d41f432b84db tempest-TestMinimumBasicScenario-1051796474 None] Lock "cinder-6312b723-7d69-429d-b14c-c14b17251070-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:58 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ad901fc0-b0b8-46ce-b056-d41f432b84db tempest-TestMinimumBasicScenario-1051796474 None] Acquiring lock "cinder-quobyte-6312b723-7d69-429d-b14c-c14b17251070" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:12:58 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ad901fc0-b0b8-46ce-b056-d41f432b84db tempest-TestMinimumBasicScenario-1051796474 None] Lock "cinder-quobyte-6312b723-7d69-429d-b14c-c14b17251070" acquired by "delete_volume" :: waited 0.024s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:12:58 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb52a75-771b-429a-b68c-698a713b3bdf]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:12:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ad901fc0-b0b8-46ce-b056-d41f432b84db tempest-TestMinimumBasicScenario-1051796474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6312b723-7d69-429d-b14c-c14b17251070 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:58 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6312b723-7d69-429d-b14c-c14b17251070 Sep 05 05:12:58 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:12:59 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Sep 05 05:12:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ad901fc0-b0b8-46ce-b056-d41f432b84db tempest-TestMinimumBasicScenario-1051796474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6312b723-7d69-429d-b14c-c14b17251070" returned: 0 in 1.163s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:12:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ad901fc0-b0b8-46ce-b056-d41f432b84db tempest-TestMinimumBasicScenario-1051796474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6312b723-7d69-429d-b14c-c14b17251070 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:12:59 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6312b723-7d69-429d-b14c-c14b17251070 Sep 05 05:12:59 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:00 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ad901fc0-b0b8-46ce-b056-d41f432b84db tempest-TestMinimumBasicScenario-1051796474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6312b723-7d69-429d-b14c-c14b17251070" returned: 0 in 0.635s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:00 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ad901fc0-b0b8-46ce-b056-d41f432b84db tempest-TestMinimumBasicScenario-1051796474 None] Lock "cinder-quobyte-6312b723-7d69-429d-b14c-c14b17251070" released by "delete_volume" :: held 1.898s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:00 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-ad901fc0-b0b8-46ce-b056-d41f432b84db tempest-TestMinimumBasicScenario-1051796474 None] Created reservations ['d0d97138-b404-4c3e-a691-b7dfe97e314e', '608ac4f9-cd24-4caf-b6ba-5f224835c6ce', '39cffc5b-cabb-4e9b-9bc4-de61a04ef68a', 'd259dafc-85b8-4d59-ada2-3f386cd24969'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:13:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ad901fc0-b0b8-46ce-b056-d41f432b84db tempest-TestMinimumBasicScenario-1051796474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ad901fc0-b0b8-46ce-b056-d41f432b84db tempest-TestMinimumBasicScenario-1051796474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:00 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ad901fc0-b0b8-46ce-b056-d41f432b84db tempest-TestMinimumBasicScenario-1051796474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:13:00 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ad901fc0-b0b8-46ce-b056-d41f432b84db tempest-TestMinimumBasicScenario-1051796474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:13:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ad901fc0-b0b8-46ce-b056-d41f432b84db tempest-TestMinimumBasicScenario-1051796474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ad901fc0-b0b8-46ce-b056-d41f432b84db tempest-TestMinimumBasicScenario-1051796474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:00 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:13:00 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:01 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-22f68585-695a-4026-b621-98e1676c7b61" returned: 0 in 6.991s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75, size 1024.00 MB, duration 6.99 sec, destination /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-22f68585-695a-4026-b621-98e1676c7b61 {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:13:01 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Converted 1024.00 MB image at 146.40 MB/s Sep 05 05:13:01 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-22f68585-695a-4026-b621-98e1676c7b61 is being set with open permissions: ugo+rw Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-22f68585-695a-4026-b621-98e1676c7b61 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:01 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-22f68585-695a-4026-b621-98e1676c7b61 Sep 05 05:13:01 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:13:01 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Flow 'volume_create_manager' (066743d3-1c02-4f90-a730-deeaa9b26be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137b2d89-3b1c-4057-a87a-00218b975942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ad901fc0-b0b8-46ce-b056-d41f432b84db tempest-TestMinimumBasicScenario-1051796474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.900s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-ad901fc0-b0b8-46ce-b056-d41f432b84db tempest-TestMinimumBasicScenario-1051796474 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:13:01 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ad901fc0-b0b8-46ce-b056-d41f432b84db tempest-TestMinimumBasicScenario-1051796474 None] Deleted volume successfully. Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137b2d89-3b1c-4057-a87a-00218b975942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2139808149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a069ec6-59c8-4bed-a46a-1233f28805b5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6cdff92e9dce4f05b9fdbc99a5e9514d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:13:01Z,use_quota=True,user_id='98c199aafb68407c924be39ce945fa04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c062c8-4990-471c-a762-caaff8ed91d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c062c8-4990-471c-a762-caaff8ed91d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13c079f-4a98-490e-8637-1e8db6d583de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13c079f-4a98-490e-8637-1e8db6d583de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a069ec6-59c8-4bed-a46a-1233f28805b5', 'volume_name': 'volume-8a069ec6-59c8-4bed-a46a-1233f28805b5', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3f7811-69ef-4e96-bf66-bc7c692a0d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3f7811-69ef-4e96-bf66-bc7c692a0d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a7aeeb2-98be-4ed9-90fa-9ba5a585d900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:01 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Volume 8a069ec6-59c8-4bed-a46a-1233f28805b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a069ec6-59c8-4bed-a46a-1233f28805b5', 'volume_size': 1} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ad901fc0-b0b8-46ce-b056-d41f432b84db tempest-TestMinimumBasicScenario-1051796474 None] Lock "cinder-6312b723-7d69-429d-b14c-c14b17251070-delete_volume" released by "delete_volume" :: held 3.508s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:01 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-22f68585-695a-4026-b621-98e1676c7b61" returned: 0 in 0.545s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-22f68585-695a-4026-b621-98e1676c7b61" released by "_copy_volume_from_snapshot" :: held 8.616s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-e04fcf02-b734-490b-8056-50890aa8a71c-22f68585-695a-4026-b621-98e1676c7b61" released by "_create_volume_from_snapshot" :: held 8.688s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.717s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.243s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2139808149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a069ec6-59c8-4bed-a46a-1233f28805b5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6cdff92e9dce4f05b9fdbc99a5e9514d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:13:01Z,use_quota=True,user_id='98c199aafb68407c924be39ce945fa04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Creating volume 8a069ec6-59c8-4bed-a46a-1233f28805b5 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:13:01 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a069ec6-59c8-4bed-a46a-1233f28805b5 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:01 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a069ec6-59c8-4bed-a46a-1233f28805b5 1073741824 Sep 05 05:13:01 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1841d3f9-bb5a-4046-b4e0-2b2e742d092d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22f68585-695a-4026-b621-98e1676c7b61', 'volume_size': 1, 'snapshot_id': 'e04fcf02-b734-490b-8056-50890aa8a71c'}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749fdabc-868d-48dc-8b17-5bcae736f7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:02 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Volume volume-22f68585-695a-4026-b621-98e1676c7b61 (22f68585-695a-4026-b621-98e1676c7b61): created successfully Sep 05 05:13:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749fdabc-868d-48dc-8b17-5bcae736f7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Flow 'volume_create_manager' (f3118f51-ac39-4985-bb14-f46cc81fec0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:13:02 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-31901028-30bd-487f-bd2a-e49b70f82d6b tempest-VolumesSnapshotTestJSON-1994781731 None] Created volume successfully. Sep 05 05:13:02 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a069ec6-59c8-4bed-a46a-1233f28805b5 1073741824" returned: 0 in 0.520s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a069ec6-59c8-4bed-a46a-1233f28805b5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:02 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a069ec6-59c8-4bed-a46a-1233f28805b5 Sep 05 05:13:02 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:02 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6e1cf675-7b93-4497-8e1e-3a946a0998e9 tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "cinder-22f68585-695a-4026-b621-98e1676c7b61-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:02 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6e1cf675-7b93-4497-8e1e-3a946a0998e9 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-22f68585-695a-4026-b621-98e1676c7b61-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:02 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6e1cf675-7b93-4497-8e1e-3a946a0998e9 tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "cinder-quobyte-22f68585-695a-4026-b621-98e1676c7b61" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:02 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6e1cf675-7b93-4497-8e1e-3a946a0998e9 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-22f68585-695a-4026-b621-98e1676c7b61" acquired by "delete_volume" :: waited 0.022s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:02 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a78d2e-1cb8-4d91-a094-07241a0c8ca8]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6e1cf675-7b93-4497-8e1e-3a946a0998e9 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-22f68585-695a-4026-b621-98e1676c7b61 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:02 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a069ec6-59c8-4bed-a46a-1233f28805b5" returned: 0 in 0.356s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:13:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a7aeeb2-98be-4ed9-90fa-9ba5a585d900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a069ec6-59c8-4bed-a46a-1233f28805b5', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743eacac-a58c-4fba-a78a-6ec8f3c40895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:02 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-22f68585-695a-4026-b621-98e1676c7b61 Sep 05 05:13:02 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:02 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Volume volume-8a069ec6-59c8-4bed-a46a-1233f28805b5 (8a069ec6-59c8-4bed-a46a-1233f28805b5): created successfully Sep 05 05:13:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743eacac-a58c-4fba-a78a-6ec8f3c40895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Flow 'volume_create_manager' (066743d3-1c02-4f90-a730-deeaa9b26be3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:13:02 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-0bd2cd47-35c2-436b-afe5-b22ef97b60a6 tempest-VolumesGetTest-84657810 None] Created volume successfully. Sep 05 05:13:03 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6e1cf675-7b93-4497-8e1e-3a946a0998e9 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-22f68585-695a-4026-b621-98e1676c7b61" returned: 0 in 0.442s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6e1cf675-7b93-4497-8e1e-3a946a0998e9 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-22f68585-695a-4026-b621-98e1676c7b61 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:03 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-22f68585-695a-4026-b621-98e1676c7b61 Sep 05 05:13:03 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:03 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6e1cf675-7b93-4497-8e1e-3a946a0998e9 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-22f68585-695a-4026-b621-98e1676c7b61" returned: 0 in 0.282s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6e1cf675-7b93-4497-8e1e-3a946a0998e9 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-22f68585-695a-4026-b621-98e1676c7b61" released by "delete_volume" :: held 0.789s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-6e1cf675-7b93-4497-8e1e-3a946a0998e9 tempest-VolumesSnapshotTestJSON-1994781731 None] Created reservations ['46751b60-3d3f-4f1f-991f-3e293a001865', '0d3b32e2-31ad-461f-9171-da5373638ad1', 'b89ac052-0e68-49d9-8c22-21bc6d35ed41', '038ac041-8f5b-4910-8856-31dc97528dce'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6e1cf675-7b93-4497-8e1e-3a946a0998e9 tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6e1cf675-7b93-4497-8e1e-3a946a0998e9 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6e1cf675-7b93-4497-8e1e-3a946a0998e9 tempest-VolumesSnapshotTestJSON-1994781731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6e1cf675-7b93-4497-8e1e-3a946a0998e9 tempest-VolumesSnapshotTestJSON-1994781731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6e1cf675-7b93-4497-8e1e-3a946a0998e9 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6e1cf675-7b93-4497-8e1e-3a946a0998e9 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:03 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:13:03 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-43939da5-d2ab-4c4f-ae0c-13d9ca9ce24b tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "cinder-e04fcf02-b734-490b-8056-50890aa8a71c-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-43939da5-d2ab-4c4f-ae0c-13d9ca9ce24b tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-e04fcf02-b734-490b-8056-50890aa8a71c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-43939da5-d2ab-4c4f-ae0c-13d9ca9ce24b tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "cinder-quobyte-a2c15a55-61f4-4a91-8e3b-4734a8c20e75" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-43939da5-d2ab-4c4f-ae0c-13d9ca9ce24b tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-a2c15a55-61f4-4a91-8e3b-4734a8c20e75" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-43939da5-d2ab-4c4f-ae0c-13d9ca9ce24b tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "cinder-quobyte-e04fcf02-b734-490b-8056-50890aa8a71c" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:03 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-43939da5-d2ab-4c4f-ae0c-13d9ca9ce24b tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-e04fcf02-b734-490b-8056-50890aa8a71c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-43939da5-d2ab-4c4f-ae0c-13d9ca9ce24b tempest-VolumesSnapshotTestJSON-1994781731 None] Deleting offline snapshot e04fcf02-b734-490b-8056-50890aa8a71c of volume a2c15a55-61f4-4a91-8e3b-4734a8c20e75 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-43939da5-d2ab-4c4f-ae0c-13d9ca9ce24b tempest-VolumesSnapshotTestJSON-1994781731 None] snapshot_file for this snap is: volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.e04fcf02-b734-490b-8056-50890aa8a71c {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6e1cf675-7b93-4497-8e1e-3a946a0998e9 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.318s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-6e1cf675-7b93-4497-8e1e-3a946a0998e9 tempest-VolumesSnapshotTestJSON-1994781731 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:13:03 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-6e1cf675-7b93-4497-8e1e-3a946a0998e9 tempest-VolumesSnapshotTestJSON-1994781731 None] Deleted volume successfully. Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b65b38-d740-4fac-aff0-f2a61f2fadc1]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-43939da5-d2ab-4c4f-ae0c-13d9ca9ce24b tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.e04fcf02-b734-490b-8056-50890aa8a71c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6e1cf675-7b93-4497-8e1e-3a946a0998e9 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-22f68585-695a-4026-b621-98e1676c7b61-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:04 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.e04fcf02-b734-490b-8056-50890aa8a71c Sep 05 05:13:04 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:04 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-43939da5-d2ab-4c4f-ae0c-13d9ca9ce24b tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.e04fcf02-b734-490b-8056-50890aa8a71c" returned: 0 in 0.454s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-43939da5-d2ab-4c4f-ae0c-13d9ca9ce24b tempest-VolumesSnapshotTestJSON-1994781731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Flow 'volume_create_manager' (600bf463-b84b-4e59-b07b-e1acdb9f98b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf36ed56-e198-472c-8642-e2027426887c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d85f03-d678-40e4-8580-3d150fe9f4c4]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-43939da5-d2ab-4c4f-ae0c-13d9ca9ce24b tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf36ed56-e198-472c-8642-e2027426887c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:13:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1295746033',display_name='tempest-VolumesGetTest-Volume-1114639288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd75920e-c431-49fa-a418-32ff2d38995b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cdff92e9dce4f05b9fdbc99a5e9514d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:13:04Z,use_quota=True,user_id='98c199aafb68407c924be39ce945fa04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c018b7-f28d-46e2-9d28-060fd1693431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c018b7-f28d-46e2-9d28-060fd1693431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dbedfb3-7cee-4704-9436-2b2d3c979b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dbedfb3-7cee-4704-9436-2b2d3c979b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd75920e-c431-49fa-a418-32ff2d38995b', 'volume_name': 'volume-fd75920e-c431-49fa-a418-32ff2d38995b', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48a638c-af07-4236-a221-58c4869bb0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48a638c-af07-4236-a221-58c4869bb0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b540b8f-2bb1-4e26-8fe6-70a67950f397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:04 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Volume fd75920e-c431-49fa-a418-32ff2d38995b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd75920e-c431-49fa-a418-32ff2d38995b', 'volume_size': 1} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:13:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1295746033',display_name='tempest-VolumesGetTest-Volume-1114639288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd75920e-c431-49fa-a418-32ff2d38995b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cdff92e9dce4f05b9fdbc99a5e9514d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:13:04Z,use_quota=True,user_id='98c199aafb68407c924be39ce945fa04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Creating volume fd75920e-c431-49fa-a418-32ff2d38995b {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:13:04 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:13:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fd75920e-c431-49fa-a418-32ff2d38995b 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:04 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75 Sep 05 05:13:04 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:04 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fd75920e-c431-49fa-a418-32ff2d38995b 1073741824 Sep 05 05:13:04 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:05 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-43939da5-d2ab-4c4f-ae0c-13d9ca9ce24b tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75" returned: 0 in 0.574s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-43939da5-d2ab-4c4f-ae0c-13d9ca9ce24b tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.e04fcf02-b734-490b-8056-50890aa8a71c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:05 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fd75920e-c431-49fa-a418-32ff2d38995b 1073741824" returned: 0 in 0.502s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:05 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.e04fcf02-b734-490b-8056-50890aa8a71c Sep 05 05:13:05 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fd75920e-c431-49fa-a418-32ff2d38995b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:05 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fd75920e-c431-49fa-a418-32ff2d38995b Sep 05 05:13:05 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:05 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fd75920e-c431-49fa-a418-32ff2d38995b" returned: 0 in 0.290s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:13:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b540b8f-2bb1-4e26-8fe6-70a67950f397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd75920e-c431-49fa-a418-32ff2d38995b', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa80b44e-85fd-4c3d-9f7a-d026ae79a657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:05 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Volume volume-fd75920e-c431-49fa-a418-32ff2d38995b (fd75920e-c431-49fa-a418-32ff2d38995b): created successfully Sep 05 05:13:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa80b44e-85fd-4c3d-9f7a-d026ae79a657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Flow 'volume_create_manager' (600bf463-b84b-4e59-b07b-e1acdb9f98b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:13:05 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-43939da5-d2ab-4c4f-ae0c-13d9ca9ce24b tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.e04fcf02-b734-490b-8056-50890aa8a71c" returned: 0 in 0.422s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-43939da5-d2ab-4c4f-ae0c-13d9ca9ce24b tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.e04fcf02-b734-490b-8056-50890aa8a71c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:05 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-f33ae2a7-8f36-4445-b92e-d40bde31e8fd tempest-VolumesGetTest-84657810 None] Created volume successfully. Sep 05 05:13:05 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.e04fcf02-b734-490b-8056-50890aa8a71c Sep 05 05:13:05 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:05 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-43939da5-d2ab-4c4f-ae0c-13d9ca9ce24b tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75.e04fcf02-b734-490b-8056-50890aa8a71c" returned: 0 in 0.258s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-43939da5-d2ab-4c4f-ae0c-13d9ca9ce24b tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-e04fcf02-b734-490b-8056-50890aa8a71c" released by "_delete_snapshot" :: held 1.847s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-43939da5-d2ab-4c4f-ae0c-13d9ca9ce24b tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-a2c15a55-61f4-4a91-8e3b-4734a8c20e75" released by "delete_snapshot" :: held 1.872s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:05 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-43939da5-d2ab-4c4f-ae0c-13d9ca9ce24b tempest-VolumesSnapshotTestJSON-1994781731 None] Created reservations ['63b271b7-89d7-466a-bd01-01aac50febf8', 'a8de5f07-e408-42ef-a2fc-ccd950f2dc25', 'ea88b6d6-a086-417c-befd-9485fe71a769', 'c65edefe-d361-4648-a9c7-8a92e387f89f'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:13:05 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-43939da5-d2ab-4c4f-ae0c-13d9ca9ce24b tempest-VolumesSnapshotTestJSON-1994781731 None] Delete snapshot completed successfully. Sep 05 05:13:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-43939da5-d2ab-4c4f-ae0c-13d9ca9ce24b tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-e04fcf02-b734-490b-8056-50890aa8a71c-delete_snapshot" released by "delete_snapshot" :: held 2.045s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f277ada4-ea02-4390-b31c-ef3609d7d0b3 tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "cinder-a2c15a55-61f4-4a91-8e3b-4734a8c20e75-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f277ada4-ea02-4390-b31c-ef3609d7d0b3 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-a2c15a55-61f4-4a91-8e3b-4734a8c20e75-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f277ada4-ea02-4390-b31c-ef3609d7d0b3 tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "cinder-quobyte-a2c15a55-61f4-4a91-8e3b-4734a8c20e75" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f277ada4-ea02-4390-b31c-ef3609d7d0b3 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-a2c15a55-61f4-4a91-8e3b-4734a8c20e75" acquired by "delete_volume" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:06 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe07292-2259-48c7-817e-a4c7adf136e9]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f277ada4-ea02-4390-b31c-ef3609d7d0b3 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:06 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75 Sep 05 05:13:06 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:06 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f277ada4-ea02-4390-b31c-ef3609d7d0b3 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75" returned: 0 in 0.391s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f277ada4-ea02-4390-b31c-ef3609d7d0b3 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ac39e83b-2f58-43d0-a72b-a4185a1f30fe tempest-VolumesGetTest-84657810 None] Acquiring lock "cinder-fd75920e-c431-49fa-a418-32ff2d38995b-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:06 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75 Sep 05 05:13:06 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ac39e83b-2f58-43d0-a72b-a4185a1f30fe tempest-VolumesGetTest-84657810 None] Lock "cinder-fd75920e-c431-49fa-a418-32ff2d38995b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ac39e83b-2f58-43d0-a72b-a4185a1f30fe tempest-VolumesGetTest-84657810 None] Acquiring lock "cinder-quobyte-fd75920e-c431-49fa-a418-32ff2d38995b" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ac39e83b-2f58-43d0-a72b-a4185a1f30fe tempest-VolumesGetTest-84657810 None] Lock "cinder-quobyte-fd75920e-c431-49fa-a418-32ff2d38995b" acquired by "delete_volume" :: waited 0.021s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:06 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8ec8b3-137b-4c5f-bad8-ecaba2d037ac]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ac39e83b-2f58-43d0-a72b-a4185a1f30fe tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fd75920e-c431-49fa-a418-32ff2d38995b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:06 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fd75920e-c431-49fa-a418-32ff2d38995b Sep 05 05:13:06 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:06 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f277ada4-ea02-4390-b31c-ef3609d7d0b3 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a2c15a55-61f4-4a91-8e3b-4734a8c20e75" returned: 0 in 0.309s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f277ada4-ea02-4390-b31c-ef3609d7d0b3 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-a2c15a55-61f4-4a91-8e3b-4734a8c20e75" released by "delete_volume" :: held 0.766s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:06 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-f277ada4-ea02-4390-b31c-ef3609d7d0b3 tempest-VolumesSnapshotTestJSON-1994781731 None] Created reservations ['c69f24d5-2737-49c4-81de-f7f24c7bff61', '7499aa7b-ee65-427b-a886-846e8476626d', '8b120949-cc3f-4be4-bdb7-276eba894d0c', 'febe482c-571d-4315-80b1-3a9be86ab425'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f277ada4-ea02-4390-b31c-ef3609d7d0b3 tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f277ada4-ea02-4390-b31c-ef3609d7d0b3 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f277ada4-ea02-4390-b31c-ef3609d7d0b3 tempest-VolumesSnapshotTestJSON-1994781731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f277ada4-ea02-4390-b31c-ef3609d7d0b3 tempest-VolumesSnapshotTestJSON-1994781731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f277ada4-ea02-4390-b31c-ef3609d7d0b3 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f277ada4-ea02-4390-b31c-ef3609d7d0b3 tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:07 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:13:07 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:07 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ac39e83b-2f58-43d0-a72b-a4185a1f30fe tempest-VolumesGetTest-84657810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fd75920e-c431-49fa-a418-32ff2d38995b" returned: 0 in 0.395s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ac39e83b-2f58-43d0-a72b-a4185a1f30fe tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fd75920e-c431-49fa-a418-32ff2d38995b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:07 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fd75920e-c431-49fa-a418-32ff2d38995b Sep 05 05:13:07 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:07 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f277ada4-ea02-4390-b31c-ef3609d7d0b3 tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.274s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-f277ada4-ea02-4390-b31c-ef3609d7d0b3 tempest-VolumesSnapshotTestJSON-1994781731 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:13:07 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-f277ada4-ea02-4390-b31c-ef3609d7d0b3 tempest-VolumesSnapshotTestJSON-1994781731 None] Deleted volume successfully. Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b29c7e34-c5a7-49ef-bcf4-2e231a9dd2bc tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "cinder-bdaea41b-1ffc-483b-92bb-6eca0804462f-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f277ada4-ea02-4390-b31c-ef3609d7d0b3 tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-a2c15a55-61f4-4a91-8e3b-4734a8c20e75-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b29c7e34-c5a7-49ef-bcf4-2e231a9dd2bc tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-bdaea41b-1ffc-483b-92bb-6eca0804462f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b29c7e34-c5a7-49ef-bcf4-2e231a9dd2bc tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "cinder-quobyte-bdaea41b-1ffc-483b-92bb-6eca0804462f" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:07 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ac39e83b-2f58-43d0-a72b-a4185a1f30fe tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fd75920e-c431-49fa-a418-32ff2d38995b" returned: 0 in 0.304s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b29c7e34-c5a7-49ef-bcf4-2e231a9dd2bc tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-bdaea41b-1ffc-483b-92bb-6eca0804462f" acquired by "delete_volume" :: waited 0.025s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ac39e83b-2f58-43d0-a72b-a4185a1f30fe tempest-VolumesGetTest-84657810 None] Lock "cinder-quobyte-fd75920e-c431-49fa-a418-32ff2d38995b" released by "delete_volume" :: held 0.761s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58705a7-128f-4b94-ac72-7ebe5401046c]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b29c7e34-c5a7-49ef-bcf4-2e231a9dd2bc tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-ac39e83b-2f58-43d0-a72b-a4185a1f30fe tempest-VolumesGetTest-84657810 None] Created reservations ['66e66a7a-dbd8-4a3d-a7c5-99f0c1cef403', 'f4f7a592-6d6d-473e-a88b-317814cbdaeb', '8b6e47b0-ba90-43f0-b721-c2714bb14fe9', '8494e2c1-0268-4de7-b2c5-5efaef433e09'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ac39e83b-2f58-43d0-a72b-a4185a1f30fe tempest-VolumesGetTest-84657810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ac39e83b-2f58-43d0-a72b-a4185a1f30fe tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ac39e83b-2f58-43d0-a72b-a4185a1f30fe tempest-VolumesGetTest-84657810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ac39e83b-2f58-43d0-a72b-a4185a1f30fe tempest-VolumesGetTest-84657810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ac39e83b-2f58-43d0-a72b-a4185a1f30fe tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ac39e83b-2f58-43d0-a72b-a4185a1f30fe tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:07 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f Sep 05 05:13:07 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:07 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:13:07 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:07 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-489597ea-27d2-4db2-b516-8d8a565a68a5 tempest-VolumesGetTest-84657810 None] Acquiring lock "cinder-8a069ec6-59c8-4bed-a46a-1233f28805b5-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ac39e83b-2f58-43d0-a72b-a4185a1f30fe tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.306s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-ac39e83b-2f58-43d0-a72b-a4185a1f30fe tempest-VolumesGetTest-84657810 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:13:07 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ac39e83b-2f58-43d0-a72b-a4185a1f30fe tempest-VolumesGetTest-84657810 None] Deleted volume successfully. Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-489597ea-27d2-4db2-b516-8d8a565a68a5 tempest-VolumesGetTest-84657810 None] Lock "cinder-8a069ec6-59c8-4bed-a46a-1233f28805b5-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:07 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b29c7e34-c5a7-49ef-bcf4-2e231a9dd2bc tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f" returned: 0 in 0.517s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b29c7e34-c5a7-49ef-bcf4-2e231a9dd2bc tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ac39e83b-2f58-43d0-a72b-a4185a1f30fe tempest-VolumesGetTest-84657810 None] Lock "cinder-fd75920e-c431-49fa-a418-32ff2d38995b-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:08 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f Sep 05 05:13:08 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-489597ea-27d2-4db2-b516-8d8a565a68a5 tempest-VolumesGetTest-84657810 None] Acquiring lock "cinder-quobyte-8a069ec6-59c8-4bed-a46a-1233f28805b5" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-489597ea-27d2-4db2-b516-8d8a565a68a5 tempest-VolumesGetTest-84657810 None] Lock "cinder-quobyte-8a069ec6-59c8-4bed-a46a-1233f28805b5" acquired by "delete_volume" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:08 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1c844c-f89b-4847-96c2-7d05e2e8390f]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-489597ea-27d2-4db2-b516-8d8a565a68a5 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a069ec6-59c8-4bed-a46a-1233f28805b5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:08 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a069ec6-59c8-4bed-a46a-1233f28805b5 Sep 05 05:13:08 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:08 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b29c7e34-c5a7-49ef-bcf4-2e231a9dd2bc tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bdaea41b-1ffc-483b-92bb-6eca0804462f" returned: 0 in 0.284s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b29c7e34-c5a7-49ef-bcf4-2e231a9dd2bc tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-quobyte-bdaea41b-1ffc-483b-92bb-6eca0804462f" released by "delete_volume" :: held 0.873s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:08 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-b29c7e34-c5a7-49ef-bcf4-2e231a9dd2bc tempest-VolumesSnapshotTestJSON-1994781731 None] Created reservations ['9727964a-39f6-4df0-9a8f-2ca1e061386f', '0a1bcde7-e819-4c73-b78a-0723c9453bf2', 'e34eff6c-2ea2-4bd7-91df-255693bba98d', '53ff7dc9-5b60-4551-96e8-7214df90947a'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:13:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b29c7e34-c5a7-49ef-bcf4-2e231a9dd2bc tempest-VolumesSnapshotTestJSON-1994781731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b29c7e34-c5a7-49ef-bcf4-2e231a9dd2bc tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b29c7e34-c5a7-49ef-bcf4-2e231a9dd2bc tempest-VolumesSnapshotTestJSON-1994781731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:13:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b29c7e34-c5a7-49ef-bcf4-2e231a9dd2bc tempest-VolumesSnapshotTestJSON-1994781731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:13:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b29c7e34-c5a7-49ef-bcf4-2e231a9dd2bc tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b29c7e34-c5a7-49ef-bcf4-2e231a9dd2bc tempest-VolumesSnapshotTestJSON-1994781731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:08 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:13:08 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:08 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-489597ea-27d2-4db2-b516-8d8a565a68a5 tempest-VolumesGetTest-84657810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a069ec6-59c8-4bed-a46a-1233f28805b5" returned: 0 in 0.425s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-489597ea-27d2-4db2-b516-8d8a565a68a5 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a069ec6-59c8-4bed-a46a-1233f28805b5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:08 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a069ec6-59c8-4bed-a46a-1233f28805b5 Sep 05 05:13:08 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:08 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b29c7e34-c5a7-49ef-bcf4-2e231a9dd2bc tempest-VolumesSnapshotTestJSON-1994781731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.316s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:08 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b29c7e34-c5a7-49ef-bcf4-2e231a9dd2bc tempest-VolumesSnapshotTestJSON-1994781731 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:13:08 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-b29c7e34-c5a7-49ef-bcf4-2e231a9dd2bc tempest-VolumesSnapshotTestJSON-1994781731 None] Deleted volume successfully. Sep 05 05:13:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b29c7e34-c5a7-49ef-bcf4-2e231a9dd2bc tempest-VolumesSnapshotTestJSON-1994781731 None] Lock "cinder-bdaea41b-1ffc-483b-92bb-6eca0804462f-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:08 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-489597ea-27d2-4db2-b516-8d8a565a68a5 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a069ec6-59c8-4bed-a46a-1233f28805b5" returned: 0 in 0.327s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-489597ea-27d2-4db2-b516-8d8a565a68a5 tempest-VolumesGetTest-84657810 None] Lock "cinder-quobyte-8a069ec6-59c8-4bed-a46a-1233f28805b5" released by "delete_volume" :: held 0.800s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:08 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-489597ea-27d2-4db2-b516-8d8a565a68a5 tempest-VolumesGetTest-84657810 None] Created reservations ['00cb9d46-a02c-4325-8eea-cbd72d57bdeb', '6293a200-f44b-4704-8ce5-d0a93f7ed6a9', '987a5883-7a36-418a-af3b-8adf25a03b6c', '06a253d7-2d6f-4b20-ada6-837957d7923f'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-489597ea-27d2-4db2-b516-8d8a565a68a5 tempest-VolumesGetTest-84657810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-489597ea-27d2-4db2-b516-8d8a565a68a5 tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-489597ea-27d2-4db2-b516-8d8a565a68a5 tempest-VolumesGetTest-84657810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-489597ea-27d2-4db2-b516-8d8a565a68a5 tempest-VolumesGetTest-84657810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-489597ea-27d2-4db2-b516-8d8a565a68a5 tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-489597ea-27d2-4db2-b516-8d8a565a68a5 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:09 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:13:09 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:09 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-489597ea-27d2-4db2-b516-8d8a565a68a5 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.337s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-489597ea-27d2-4db2-b516-8d8a565a68a5 tempest-VolumesGetTest-84657810 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:13:09 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-489597ea-27d2-4db2-b516-8d8a565a68a5 tempest-VolumesGetTest-84657810 None] Deleted volume successfully. Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-489597ea-27d2-4db2-b516-8d8a565a68a5 tempest-VolumesGetTest-84657810 None] Lock "cinder-8a069ec6-59c8-4bed-a46a-1233f28805b5-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Flow 'volume_create_manager' (1d6d6372-9a58-4a01-8be1-d0d8b0d23e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb5c30e-b9ae-4b02-980f-478597a6a353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb5c30e-b9ae-4b02-980f-478597a6a353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-40541449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5975905e-2bd1-4145-b6c0-6c0c2f4469d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cdff92e9dce4f05b9fdbc99a5e9514d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:13:10Z,use_quota=True,user_id='98c199aafb68407c924be39ce945fa04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (416efcf3-8c16-4617-af03-caeb4886deb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (416efcf3-8c16-4617-af03-caeb4886deb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b17ac1-4c4f-46e4-8730-a1fb0533e763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b17ac1-4c4f-46e4-8730-a1fb0533e763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5975905e-2bd1-4145-b6c0-6c0c2f4469d0', 'volume_name': 'volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf1630a4-81ed-4f47-a621-8b2b53b8205e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf1630a4-81ed-4f47-a621-8b2b53b8205e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70db50b5-98b8-4145-aa48-aba6ddfa78ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:09 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Volume 5975905e-2bd1-4145-b6c0-6c0c2f4469d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0', 'volume_size': 1} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-40541449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5975905e-2bd1-4145-b6c0-6c0c2f4469d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cdff92e9dce4f05b9fdbc99a5e9514d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:13:10Z,use_quota=True,user_id='98c199aafb68407c924be39ce945fa04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Creating volume 5975905e-2bd1-4145-b6c0-6c0c2f4469d0 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:13:09 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:13:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:09 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0 1073741824 Sep 05 05:13:09 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:10 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0 1073741824" returned: 0 in 0.537s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:10 devstack sudo[101629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0 Sep 05 05:13:10 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:10 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0" returned: 0 in 0.265s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:13:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70db50b5-98b8-4145-aa48-aba6ddfa78ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54dd2faa-2f5b-40ab-837e-9867d0cfa267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:10 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Volume volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0 (5975905e-2bd1-4145-b6c0-6c0c2f4469d0): created successfully Sep 05 05:13:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54dd2faa-2f5b-40ab-837e-9867d0cfa267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Flow 'volume_create_manager' (1d6d6372-9a58-4a01-8be1-d0d8b0d23e39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:13:10 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-78438c12-049e-43f8-b2f0-e6051c98cead tempest-VolumesGetTest-84657810 None] Created volume successfully. Sep 05 05:13:12 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:13:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Flow 'volume_create_manager' (a1c630bb-8e55-4cf0-b3bc-e6fd39ab8d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:13:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a53404b-c611-48bd-a14f-793b15db6d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a53404b-c611-48bd-a14f-793b15db6d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1619544596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b144373-499d-4fd7-954e-13c88fb1b62b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6cdff92e9dce4f05b9fdbc99a5e9514d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5975905e-2bd1-4145-b6c0-6c0c2f4469d0,status='creating',terminated_at=None,updated_at=2026-09-05T03:13:12Z,use_quota=True,user_id='98c199aafb68407c924be39ce945fa04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168d36a0-0c6e-4d26-a65f-9ffb47ebd33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168d36a0-0c6e-4d26-a65f-9ffb47ebd33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afca81d3-8d62-456c-9c55-b0715da3ff55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afca81d3-8d62-456c-9c55-b0715da3ff55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7b144373-499d-4fd7-954e-13c88fb1b62b', 'volume_name': 'volume-7b144373-499d-4fd7-954e-13c88fb1b62b', 'volume_size': 1, 'source_volid': '5975905e-2bd1-4145-b6c0-6c0c2f4469d0', 'source_volstatus': 'available'}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0faaba66-4146-4d2f-bd55-64a5167004c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0faaba66-4146-4d2f-bd55-64a5167004c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45842080-6b07-4a55-b2cf-ac71fe2ac5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:12 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Volume 7b144373-499d-4fd7-954e-13c88fb1b62b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7b144373-499d-4fd7-954e-13c88fb1b62b', 'volume_size': 1, 'source_volid': '5975905e-2bd1-4145-b6c0-6c0c2f4469d0', 'source_volstatus': 'available'} Sep 05 05:13:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:12 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Cloning volume 5975905e-2bd1-4145-b6c0-6c0c2f4469d0 to volume 7b144373-499d-4fd7-954e-13c88fb1b62b Sep 05 05:13:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Creating offline snapshot 5f0371cb-fcca-495a-8c15-9a5c35a5d029 of volume 5975905e-2bd1-4145-b6c0-6c0c2f4469d0 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:13:12 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8c9ef0-4d28-43e8-9df4-0b7d2c014d72]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:12 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0 Sep 05 05:13:12 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:13 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0" returned: 0 in 0.409s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.5f0371cb-fcca-495a-8c15-9a5c35a5d029 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:13 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.5f0371cb-fcca-495a-8c15-9a5c35a5d029 1G Sep 05 05:13:13 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:13 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.5f0371cb-fcca-495a-8c15-9a5c35a5d029 1G" returned: 0 in 0.543s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.5f0371cb-fcca-495a-8c15-9a5c35a5d029 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:13 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.5f0371cb-fcca-495a-8c15-9a5c35a5d029 Sep 05 05:13:13 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:13 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.5f0371cb-fcca-495a-8c15-9a5c35a5d029" returned: 0 in 0.356s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:13 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.5f0371cb-fcca-495a-8c15-9a5c35a5d029 is being set with open permissions: ugo+rw Sep 05 05:13:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.5f0371cb-fcca-495a-8c15-9a5c35a5d029 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:13 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.5f0371cb-fcca-495a-8c15-9a5c35a5d029 Sep 05 05:13:13 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:14 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.5f0371cb-fcca-495a-8c15-9a5c35a5d029" returned: 0 in 0.294s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:14 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.info Sep 05 05:13:14 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:14 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.info" returned: 0 in 0.322s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:14 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.info is being set with open permissions: ugo+rw Sep 05 05:13:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:14 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.info Sep 05 05:13:14 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:14 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.info" returned: 0 in 0.252s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:14 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Acquiring lock "cinder-quobyte-7b144373-499d-4fd7-954e-13c88fb1b62b" by "_copy_volume_from_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:14 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Lock "cinder-quobyte-7b144373-499d-4fd7-954e-13c88fb1b62b" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:14 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] snapshot: 5f0371cb-fcca-495a-8c15-9a5c35a5d029, volume: 7b144373-499d-4fd7-954e-13c88fb1b62b, {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 05:13:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:14 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:13:14 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:13:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:14 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2c8ea7-43fa-461b-a9f6-a170871358ee]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.5f0371cb-fcca-495a-8c15-9a5c35a5d029 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:15 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.5f0371cb-fcca-495a-8c15-9a5c35a5d029 Sep 05 05:13:15 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:15 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.5f0371cb-fcca-495a-8c15-9a5c35a5d029" returned: 0 in 0.412s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:15 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:13:15 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[23feff5d-527c-41c4-9cf3-89fb1b45f32b]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:15 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0 Sep 05 05:13:15 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:15 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0" returned: 0 in 0.459s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:15 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0 {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 05:13:15 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Creating direct copy from snapshot {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 05:13:15 devstack cinder-volume[89331]: DEBUG cinder.utils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Path /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b144373-499d-4fd7-954e-13c88fb1b62b not found in is_blk_device check {{(pid=89331) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 05:13:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b144373-499d-4fd7-954e-13c88fb1b62b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:15 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b144373-499d-4fd7-954e-13c88fb1b62b Sep 05 05:13:15 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:21 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b144373-499d-4fd7-954e-13c88fb1b62b" returned: 0 in 5.648s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:21 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0, size 1024.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b144373-499d-4fd7-954e-13c88fb1b62b {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:13:21 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Converted 1024.00 MB image at 181.26 MB/s Sep 05 05:13:21 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b144373-499d-4fd7-954e-13c88fb1b62b is being set with open permissions: ugo+rw Sep 05 05:13:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b144373-499d-4fd7-954e-13c88fb1b62b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:21 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b144373-499d-4fd7-954e-13c88fb1b62b Sep 05 05:13:21 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:21 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b144373-499d-4fd7-954e-13c88fb1b62b" returned: 0 in 0.274s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:21 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Lock "cinder-quobyte-7b144373-499d-4fd7-954e-13c88fb1b62b" released by "_copy_volume_from_snapshot" :: held 6.906s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:21 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Acquiring lock "cinder-quobyte-5f0371cb-fcca-495a-8c15-9a5c35a5d029" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:21 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Lock "cinder-quobyte-5f0371cb-fcca-495a-8c15-9a5c35a5d029" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Deleting offline snapshot 5f0371cb-fcca-495a-8c15-9a5c35a5d029 of volume 5975905e-2bd1-4145-b6c0-6c0c2f4469d0 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:13:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] snapshot_file for this snap is: volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.5f0371cb-fcca-495a-8c15-9a5c35a5d029 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:13:21 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[650b019b-b5da-4050-8ac5-d4bf60c39318]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.5f0371cb-fcca-495a-8c15-9a5c35a5d029 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:22 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.5f0371cb-fcca-495a-8c15-9a5c35a5d029 Sep 05 05:13:22 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:22 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.5f0371cb-fcca-495a-8c15-9a5c35a5d029" returned: 0 in 0.408s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:13:22 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[051f8bdb-5869-4b4b-8091-94c6ba69f895]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:22 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0 Sep 05 05:13:22 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:22 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0" returned: 0 in 0.603s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.5f0371cb-fcca-495a-8c15-9a5c35a5d029 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:23 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.5f0371cb-fcca-495a-8c15-9a5c35a5d029 Sep 05 05:13:23 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:23 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.5f0371cb-fcca-495a-8c15-9a5c35a5d029" returned: 0 in 0.398s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.5f0371cb-fcca-495a-8c15-9a5c35a5d029 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:23 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.5f0371cb-fcca-495a-8c15-9a5c35a5d029 Sep 05 05:13:23 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:23 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0.5f0371cb-fcca-495a-8c15-9a5c35a5d029" returned: 0 in 0.295s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:23 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Lock "cinder-quobyte-5f0371cb-fcca-495a-8c15-9a5c35a5d029" released by "_delete_snapshot" :: held 1.820s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.155s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45842080-6b07-4a55-b2cf-ac71fe2ac5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b144373-499d-4fd7-954e-13c88fb1b62b', 'volume_size': 1, 'source_volid': '5975905e-2bd1-4145-b6c0-6c0c2f4469d0', 'source_volstatus': 'available'}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f30a32a8-8ebb-488e-8158-4f884e7d6516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:23 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Volume volume-7b144373-499d-4fd7-954e-13c88fb1b62b (7b144373-499d-4fd7-954e-13c88fb1b62b): created successfully Sep 05 05:13:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f30a32a8-8ebb-488e-8158-4f884e7d6516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Flow 'volume_create_manager' (a1c630bb-8e55-4cf0-b3bc-e6fd39ab8d67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:13:23 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-c1627919-ea86-4f66-8a4f-fd590fa949f7 tempest-VolumesGetTest-84657810 None] Created volume successfully. Sep 05 05:13:25 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:13:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Flow 'volume_create_manager' (20aff460-7f9d-4936-94f4-e22819c59dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:13:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69200f7a-0bbe-42c5-9a8f-a76417a12cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69200f7a-0bbe-42c5-9a8f-a76417a12cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:13:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-510601043',display_name='tempest-VolumesGetTest-Volume-716543401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=569f2713-d0ee-43d3-a8a4-733d31806426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cdff92e9dce4f05b9fdbc99a5e9514d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:13:26Z,use_quota=True,user_id='98c199aafb68407c924be39ce945fa04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1838cb44-3fd2-4371-b06d-b3927e541041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1838cb44-3fd2-4371-b06d-b3927e541041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c8033d-906e-4bbc-ae3a-43418a0fa188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c8033d-906e-4bbc-ae3a-43418a0fa188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '569f2713-d0ee-43d3-a8a4-733d31806426', 'volume_name': 'volume-569f2713-d0ee-43d3-a8a4-733d31806426', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae90fdf9-1fba-4cd3-8874-551a421b293f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae90fdf9-1fba-4cd3-8874-551a421b293f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b703280-26ac-4feb-9d28-c37c0da82c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:25 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Volume 569f2713-d0ee-43d3-a8a4-733d31806426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-569f2713-d0ee-43d3-a8a4-733d31806426', 'volume_size': 1} Sep 05 05:13:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:13:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-510601043',display_name='tempest-VolumesGetTest-Volume-716543401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=569f2713-d0ee-43d3-a8a4-733d31806426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cdff92e9dce4f05b9fdbc99a5e9514d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:13:26Z,use_quota=True,user_id='98c199aafb68407c924be39ce945fa04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:13:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Creating volume 569f2713-d0ee-43d3-a8a4-733d31806426 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:13:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:13:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:13:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:13:25 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:13:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-569f2713-d0ee-43d3-a8a4-733d31806426 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:25 devstack sudo[101712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-569f2713-d0ee-43d3-a8a4-733d31806426 1073741824 Sep 05 05:13:25 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:26 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-569f2713-d0ee-43d3-a8a4-733d31806426 1073741824" returned: 0 in 0.524s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-569f2713-d0ee-43d3-a8a4-733d31806426 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:26 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-569f2713-d0ee-43d3-a8a4-733d31806426 Sep 05 05:13:26 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:26 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-569f2713-d0ee-43d3-a8a4-733d31806426" returned: 0 in 0.295s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:13:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b703280-26ac-4feb-9d28-c37c0da82c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-569f2713-d0ee-43d3-a8a4-733d31806426', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7363dd0b-ec27-4739-8d16-1f5c5394a318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:26 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Volume volume-569f2713-d0ee-43d3-a8a4-733d31806426 (569f2713-d0ee-43d3-a8a4-733d31806426): created successfully Sep 05 05:13:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7363dd0b-ec27-4739-8d16-1f5c5394a318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Flow 'volume_create_manager' (20aff460-7f9d-4936-94f4-e22819c59dc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:13:26 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-1b629440-4c33-402d-81b6-bbfa42192e77 tempest-VolumesGetTest-84657810 None] Created volume successfully. Sep 05 05:13:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d361bde5-817b-4415-beaf-7034638edb4d tempest-VolumesGetTest-84657810 None] Acquiring lock "cinder-569f2713-d0ee-43d3-a8a4-733d31806426-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d361bde5-817b-4415-beaf-7034638edb4d tempest-VolumesGetTest-84657810 None] Lock "cinder-569f2713-d0ee-43d3-a8a4-733d31806426-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d361bde5-817b-4415-beaf-7034638edb4d tempest-VolumesGetTest-84657810 None] Acquiring lock "cinder-quobyte-569f2713-d0ee-43d3-a8a4-733d31806426" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d361bde5-817b-4415-beaf-7034638edb4d tempest-VolumesGetTest-84657810 None] Lock "cinder-quobyte-569f2713-d0ee-43d3-a8a4-733d31806426" acquired by "delete_volume" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:28 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30acd0b-a21b-4007-a9c0-8a71cc289194]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d361bde5-817b-4415-beaf-7034638edb4d tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-569f2713-d0ee-43d3-a8a4-733d31806426 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:28 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-569f2713-d0ee-43d3-a8a4-733d31806426 Sep 05 05:13:28 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:28 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d361bde5-817b-4415-beaf-7034638edb4d tempest-VolumesGetTest-84657810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-569f2713-d0ee-43d3-a8a4-733d31806426" returned: 0 in 0.460s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d361bde5-817b-4415-beaf-7034638edb4d tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-569f2713-d0ee-43d3-a8a4-733d31806426 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:28 devstack sudo[101725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-569f2713-d0ee-43d3-a8a4-733d31806426 Sep 05 05:13:28 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:28 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d361bde5-817b-4415-beaf-7034638edb4d tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-569f2713-d0ee-43d3-a8a4-733d31806426" returned: 0 in 0.279s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d361bde5-817b-4415-beaf-7034638edb4d tempest-VolumesGetTest-84657810 None] Lock "cinder-quobyte-569f2713-d0ee-43d3-a8a4-733d31806426" released by "delete_volume" :: held 0.789s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:28 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-d361bde5-817b-4415-beaf-7034638edb4d tempest-VolumesGetTest-84657810 None] Created reservations ['07791aee-e76a-4f1a-96d8-5da1a6f30d93', 'bea5b5bf-5fe4-48a8-9487-d276a5847f5f', '73c39556-d62f-4556-af4a-f57f1047b971', '55a75eff-fbe7-4388-8972-b8e879064c68'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:13:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d361bde5-817b-4415-beaf-7034638edb4d tempest-VolumesGetTest-84657810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d361bde5-817b-4415-beaf-7034638edb4d tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d361bde5-817b-4415-beaf-7034638edb4d tempest-VolumesGetTest-84657810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:13:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d361bde5-817b-4415-beaf-7034638edb4d tempest-VolumesGetTest-84657810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:13:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d361bde5-817b-4415-beaf-7034638edb4d tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d361bde5-817b-4415-beaf-7034638edb4d tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:28 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:13:28 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8c4f28d9-fb79-454f-bb58-7cc0f65738a1 tempest-VolumesGetTest-84657810 None] Acquiring lock "cinder-7b144373-499d-4fd7-954e-13c88fb1b62b-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8c4f28d9-fb79-454f-bb58-7cc0f65738a1 tempest-VolumesGetTest-84657810 None] Lock "cinder-7b144373-499d-4fd7-954e-13c88fb1b62b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8c4f28d9-fb79-454f-bb58-7cc0f65738a1 tempest-VolumesGetTest-84657810 None] Acquiring lock "cinder-quobyte-7b144373-499d-4fd7-954e-13c88fb1b62b" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8c4f28d9-fb79-454f-bb58-7cc0f65738a1 tempest-VolumesGetTest-84657810 None] Lock "cinder-quobyte-7b144373-499d-4fd7-954e-13c88fb1b62b" acquired by "delete_volume" :: waited 0.023s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:29 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d361bde5-817b-4415-beaf-7034638edb4d tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.375s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:29 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-d361bde5-817b-4415-beaf-7034638edb4d tempest-VolumesGetTest-84657810 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:13:29 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0aab7e-9fc8-4b67-9ac3-930ca14db902]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8c4f28d9-fb79-454f-bb58-7cc0f65738a1 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b144373-499d-4fd7-954e-13c88fb1b62b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:29 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-d361bde5-817b-4415-beaf-7034638edb4d tempest-VolumesGetTest-84657810 None] Deleted volume successfully. Sep 05 05:13:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d361bde5-817b-4415-beaf-7034638edb4d tempest-VolumesGetTest-84657810 None] Lock "cinder-569f2713-d0ee-43d3-a8a4-733d31806426-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:29 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b144373-499d-4fd7-954e-13c88fb1b62b Sep 05 05:13:29 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:29 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8c4f28d9-fb79-454f-bb58-7cc0f65738a1 tempest-VolumesGetTest-84657810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b144373-499d-4fd7-954e-13c88fb1b62b" returned: 0 in 0.417s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8c4f28d9-fb79-454f-bb58-7cc0f65738a1 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b144373-499d-4fd7-954e-13c88fb1b62b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:29 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b144373-499d-4fd7-954e-13c88fb1b62b Sep 05 05:13:29 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:29 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8c4f28d9-fb79-454f-bb58-7cc0f65738a1 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b144373-499d-4fd7-954e-13c88fb1b62b" returned: 0 in 0.259s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8c4f28d9-fb79-454f-bb58-7cc0f65738a1 tempest-VolumesGetTest-84657810 None] Lock "cinder-quobyte-7b144373-499d-4fd7-954e-13c88fb1b62b" released by "delete_volume" :: held 0.744s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:30 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-8c4f28d9-fb79-454f-bb58-7cc0f65738a1 tempest-VolumesGetTest-84657810 None] Created reservations ['f5ceab06-df14-4459-82da-259e5ec5e72b', '414ae672-367d-4f03-9f4d-df57454db616', '8b177e76-03f3-4bc3-8e8f-3a2479a40ddc', '9e19ff48-8fb6-4c6e-b678-b3a321ac1b60'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:13:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8c4f28d9-fb79-454f-bb58-7cc0f65738a1 tempest-VolumesGetTest-84657810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8c4f28d9-fb79-454f-bb58-7cc0f65738a1 tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:30 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8c4f28d9-fb79-454f-bb58-7cc0f65738a1 tempest-VolumesGetTest-84657810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:13:30 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8c4f28d9-fb79-454f-bb58-7cc0f65738a1 tempest-VolumesGetTest-84657810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:13:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8c4f28d9-fb79-454f-bb58-7cc0f65738a1 tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8c4f28d9-fb79-454f-bb58-7cc0f65738a1 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:30 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:13:30 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:30 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8c4f28d9-fb79-454f-bb58-7cc0f65738a1 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.364s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:30 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-8c4f28d9-fb79-454f-bb58-7cc0f65738a1 tempest-VolumesGetTest-84657810 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:13:30 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-8c4f28d9-fb79-454f-bb58-7cc0f65738a1 tempest-VolumesGetTest-84657810 None] Deleted volume successfully. Sep 05 05:13:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-980bd835-da26-4667-a42e-70ed380cb649 tempest-VolumesGetTest-84657810 None] Acquiring lock "cinder-5975905e-2bd1-4145-b6c0-6c0c2f4469d0-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-980bd835-da26-4667-a42e-70ed380cb649 tempest-VolumesGetTest-84657810 None] Lock "cinder-5975905e-2bd1-4145-b6c0-6c0c2f4469d0-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8c4f28d9-fb79-454f-bb58-7cc0f65738a1 tempest-VolumesGetTest-84657810 None] Lock "cinder-7b144373-499d-4fd7-954e-13c88fb1b62b-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-980bd835-da26-4667-a42e-70ed380cb649 tempest-VolumesGetTest-84657810 None] Acquiring lock "cinder-quobyte-5975905e-2bd1-4145-b6c0-6c0c2f4469d0" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-980bd835-da26-4667-a42e-70ed380cb649 tempest-VolumesGetTest-84657810 None] Lock "cinder-quobyte-5975905e-2bd1-4145-b6c0-6c0c2f4469d0" acquired by "delete_volume" :: waited 0.023s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:30 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dac2733-d926-4b34-8b73-7dd4b73bac65]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-980bd835-da26-4667-a42e-70ed380cb649 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:30 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0 Sep 05 05:13:30 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:31 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-980bd835-da26-4667-a42e-70ed380cb649 tempest-VolumesGetTest-84657810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0" returned: 0 in 0.409s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-980bd835-da26-4667-a42e-70ed380cb649 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:31 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0 Sep 05 05:13:31 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:31 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-980bd835-da26-4667-a42e-70ed380cb649 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5975905e-2bd1-4145-b6c0-6c0c2f4469d0" returned: 0 in 0.311s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-980bd835-da26-4667-a42e-70ed380cb649 tempest-VolumesGetTest-84657810 None] Lock "cinder-quobyte-5975905e-2bd1-4145-b6c0-6c0c2f4469d0" released by "delete_volume" :: held 0.806s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:31 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-980bd835-da26-4667-a42e-70ed380cb649 tempest-VolumesGetTest-84657810 None] Created reservations ['831c2ae5-6d47-45c2-88e8-c6264a165825', '3ec081cf-698f-4426-9417-a1595834f613', '39db3e19-63ec-4539-a195-215cdc13b50b', 'fc092c18-40c8-4197-b49f-1c11b0ec66ba'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:13:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-980bd835-da26-4667-a42e-70ed380cb649 tempest-VolumesGetTest-84657810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-980bd835-da26-4667-a42e-70ed380cb649 tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-980bd835-da26-4667-a42e-70ed380cb649 tempest-VolumesGetTest-84657810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:13:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-980bd835-da26-4667-a42e-70ed380cb649 tempest-VolumesGetTest-84657810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:13:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-980bd835-da26-4667-a42e-70ed380cb649 tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-980bd835-da26-4667-a42e-70ed380cb649 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:31 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:13:31 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:32 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-980bd835-da26-4667-a42e-70ed380cb649 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.385s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:32 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-980bd835-da26-4667-a42e-70ed380cb649 tempest-VolumesGetTest-84657810 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:13:32 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-980bd835-da26-4667-a42e-70ed380cb649 tempest-VolumesGetTest-84657810 None] Deleted volume successfully. Sep 05 05:13:32 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-980bd835-da26-4667-a42e-70ed380cb649 tempest-VolumesGetTest-84657810 None] Lock "cinder-5975905e-2bd1-4145-b6c0-6c0c2f4469d0-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:32 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:13:32 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Flow 'volume_create_manager' (38f241e7-5f2c-4f45-936c-80e529308647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:13:32 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c2c124-9b08-41a4-8493-1a7895ba51d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:32 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c2c124-9b08-41a4-8493-1a7895ba51d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1401294874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c9919a7-f5cd-4490-95af-7cea70b39e41,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6cdff92e9dce4f05b9fdbc99a5e9514d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:13:33Z,use_quota=True,user_id='98c199aafb68407c924be39ce945fa04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:32 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f719d9a4-764d-4735-9e92-bb205cc2a8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:32 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f719d9a4-764d-4735-9e92-bb205cc2a8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:32 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb4d5ca7-b89b-4c43-8092-fb0dda6e4485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:32 devstack cinder-volume[89331]: DEBUG cinder.image.glance [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Creating Keystone auth plugin from conf {{(pid=89331) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 05:13:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb4d5ca7-b89b-4c43-8092-fb0dda6e4485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0c9919a7-f5cd-4490-95af-7cea70b39e41', 'volume_name': 'volume-0c9919a7-f5cd-4490-95af-7cea70b39e41', 'volume_size': 1, 'image_id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '06b067117d184688bd2e16e21ff323f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'created_at': datetime.datetime(2026, 9, 5, 2, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 55, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84fcaf8-f5e2-4d8d-b2a8-e1c627c6bece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84fcaf8-f5e2-4d8d-b2a8-e1c627c6bece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec821a6c-9e93-499e-81f6-a613c01a924d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:33 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Volume 0c9919a7-f5cd-4490-95af-7cea70b39e41: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0c9919a7-f5cd-4490-95af-7cea70b39e41', 'volume_size': 1, 'image_id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '06b067117d184688bd2e16e21ff323f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'created_at': datetime.datetime(2026, 9, 5, 2, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 55, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 05:13:33 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Trying to clone 0c9919a7-f5cd-4490-95af-7cea70b39e41 from image a60f4e58-9471-4dd7-bff3-114bdbd77a8d at location (None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}]). {{(pid=89331) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 05:13:33 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_sel_aun4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 05:13:33 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Image download 20.69 MB at 20.69 MB/s Sep 05 05:13:33 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f90162c-9997-4ac4-a1f3-5e82dc5b3ee4]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_sel_aun4devstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:33 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_sel_aun4devstack@QuobyteHD Sep 05 05:13:33 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:34 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_sel_aun4devstack@QuobyteHD" returned: 0 in 0.404s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:34 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Temporary image a60f4e58-9471-4dd7-bff3-114bdbd77a8d is fetched for user 98c199aafb68407c924be39ce945fa04. {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 05:13:34 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2dc064-7e61-4a80-82e3-d20a06341c32]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_sel_aun4devstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:34 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_sel_aun4devstack@QuobyteHD Sep 05 05:13:34 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:34 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_sel_aun4devstack@QuobyteHD" returned: 0 in 0.460s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1401294874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c9919a7-f5cd-4490-95af-7cea70b39e41,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6cdff92e9dce4f05b9fdbc99a5e9514d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:13:33Z,use_quota=True,user_id='98c199aafb68407c924be39ce945fa04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:13:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Creating volume 0c9919a7-f5cd-4490-95af-7cea70b39e41 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:13:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:13:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:13:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:13:34 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:13:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0c9919a7-f5cd-4490-95af-7cea70b39e41 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:34 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0c9919a7-f5cd-4490-95af-7cea70b39e41 1073741824 Sep 05 05:13:34 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:35 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0c9919a7-f5cd-4490-95af-7cea70b39e41 1073741824" returned: 0 in 0.535s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0c9919a7-f5cd-4490-95af-7cea70b39e41 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:35 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0c9919a7-f5cd-4490-95af-7cea70b39e41 Sep 05 05:13:35 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:35 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0c9919a7-f5cd-4490-95af-7cea70b39e41" returned: 0 in 0.312s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:13:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:35 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Attempting download of a60f4e58-9471-4dd7-bff3-114bdbd77a8d ((None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}])) to volume 0c9919a7-f5cd-4490-95af-7cea70b39e41. {{(pid=89331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 05:13:35 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b84daa-07d0-4617-8c1f-d8095ab843ea]: (4, 'raw') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_yp1ykjn7 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:35 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_yp1ykjn7 Sep 05 05:13:35 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:36 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_yp1ykjn7" returned: 0 in 0.385s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_yp1ykjn7 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:36 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_yp1ykjn7 Sep 05 05:13:36 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:36 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_yp1ykjn7" returned: 1 in 0.427s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_yp1ykjn7' failed. Not Retrying. {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 05:13:36 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad03dd17-4c2d-4be3-8a38-168dae700213]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_sel_aun4devstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:36 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_sel_aun4devstack@QuobyteHD Sep 05 05:13:36 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:37 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_sel_aun4devstack@QuobyteHD" returned: 0 in 0.375s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:37 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] a60f4e58-9471-4dd7-bff3-114bdbd77a8d was qcow2, converting to qcow2 {{(pid=89331) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 05:13:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_sel_aun4devstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0c9919a7-f5cd-4490-95af-7cea70b39e41 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:37 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_sel_aun4devstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0c9919a7-f5cd-4490-95af-7cea70b39e41 Sep 05 05:13:37 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:39 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_sel_aun4devstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0c9919a7-f5cd-4490-95af-7cea70b39e41" returned: 0 in 2.188s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:39 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_sel_aun4devstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0c9919a7-f5cd-4490-95af-7cea70b39e41 {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:13:39 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Converted 112.00 MB image at 51.16 MB/s Sep 05 05:13:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0c9919a7-f5cd-4490-95af-7cea70b39e41 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:39 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0c9919a7-f5cd-4490-95af-7cea70b39e41 1G Sep 05 05:13:39 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:39 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0c9919a7-f5cd-4490-95af-7cea70b39e41 1G" returned: 0 in 0.374s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:39 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Downloaded image a60f4e58-9471-4dd7-bff3-114bdbd77a8d ((None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}])) to volume 0c9919a7-f5cd-4490-95af-7cea70b39e41 successfully. {{(pid=89331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 05:13:39 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Temporary image a60f4e58-9471-4dd7-bff3-114bdbd77a8d for user 98c199aafb68407c924be39ce945fa04 is deleted. {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 05:13:39 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Marking volume 0c9919a7-f5cd-4490-95af-7cea70b39e41 as bootable. {{(pid=89331) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 05:13:39 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Copying metadata from image a60f4e58-9471-4dd7-bff3-114bdbd77a8d to 0c9919a7-f5cd-4490-95af-7cea70b39e41. {{(pid=89331) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 05:13:39 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Creating volume glance metadata for volume 0c9919a7-f5cd-4490-95af-7cea70b39e41 backed by image a60f4e58-9471-4dd7-bff3-114bdbd77a8d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89331) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 05:13:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec821a6c-9e93-499e-81f6-a613c01a924d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c9919a7-f5cd-4490-95af-7cea70b39e41', 'volume_size': 1, 'image_id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '06b067117d184688bd2e16e21ff323f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'created_at': datetime.datetime(2026, 9, 5, 2, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 55, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55a7dfc-f3ac-4cfd-b567-2cd0f9d0c23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:39 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Volume volume-0c9919a7-f5cd-4490-95af-7cea70b39e41 (0c9919a7-f5cd-4490-95af-7cea70b39e41): created successfully Sep 05 05:13:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55a7dfc-f3ac-4cfd-b567-2cd0f9d0c23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Flow 'volume_create_manager' (38f241e7-5f2c-4f45-936c-80e529308647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:13:39 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-7a661a16-b4d1-4d4f-99cd-556cbf9d3ea3 tempest-VolumesGetTest-84657810 None] Created volume successfully. Sep 05 05:13:40 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:13:40 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Flow 'volume_create_manager' (2f294e5b-1e5a-429f-9b4b-7a5cf2f9ad96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:13:40 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97c9ec6-2571-4b86-b438-d6da3784aab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:40 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97c9ec6-2571-4b86-b438-d6da3784aab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:13:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-195269002',display_name='tempest-VolumesGetTest-Volume-1821813439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83621b0c-0bed-4354-bc7f-5579a0f70367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cdff92e9dce4f05b9fdbc99a5e9514d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:13:41Z,use_quota=True,user_id='98c199aafb68407c924be39ce945fa04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:40 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a4d91ea-fdfd-4139-b779-0ede167bba82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:40 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a4d91ea-fdfd-4139-b779-0ede167bba82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:40 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9bdf34-7d0a-4b4f-997a-1c3e844490ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:40 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9bdf34-7d0a-4b4f-997a-1c3e844490ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83621b0c-0bed-4354-bc7f-5579a0f70367', 'volume_name': 'volume-83621b0c-0bed-4354-bc7f-5579a0f70367', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:40 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dba9b9b-0d0d-4aac-8ace-291e9412cfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:41 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dba9b9b-0d0d-4aac-8ace-291e9412cfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:41 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f98b4c-e935-465c-976f-d7a924c29a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:41 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Volume 83621b0c-0bed-4354-bc7f-5579a0f70367: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83621b0c-0bed-4354-bc7f-5579a0f70367', 'volume_size': 1} Sep 05 05:13:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:41 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:13:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-195269002',display_name='tempest-VolumesGetTest-Volume-1821813439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83621b0c-0bed-4354-bc7f-5579a0f70367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cdff92e9dce4f05b9fdbc99a5e9514d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:13:41Z,use_quota=True,user_id='98c199aafb68407c924be39ce945fa04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:13:41 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Creating volume 83621b0c-0bed-4354-bc7f-5579a0f70367 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:13:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:41 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:13:41 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:13:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:41 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:13:41 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:13:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-83621b0c-0bed-4354-bc7f-5579a0f70367 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:41 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-83621b0c-0bed-4354-bc7f-5579a0f70367 1073741824 Sep 05 05:13:41 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:41 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-83621b0c-0bed-4354-bc7f-5579a0f70367 1073741824" returned: 0 in 0.550s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-83621b0c-0bed-4354-bc7f-5579a0f70367 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:41 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-83621b0c-0bed-4354-bc7f-5579a0f70367 Sep 05 05:13:41 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:41 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-83621b0c-0bed-4354-bc7f-5579a0f70367" returned: 0 in 0.292s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:41 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:13:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:41 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f98b4c-e935-465c-976f-d7a924c29a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83621b0c-0bed-4354-bc7f-5579a0f70367', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:41 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3875d4b9-5370-4723-a06f-5d088f6393dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:41 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Volume volume-83621b0c-0bed-4354-bc7f-5579a0f70367 (83621b0c-0bed-4354-bc7f-5579a0f70367): created successfully Sep 05 05:13:41 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3875d4b9-5370-4723-a06f-5d088f6393dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:41 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Flow 'volume_create_manager' (2f294e5b-1e5a-429f-9b4b-7a5cf2f9ad96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:13:41 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-8217b786-df8d-47c7-9474-42a7c1131dec tempest-VolumesGetTest-84657810 None] Created volume successfully. Sep 05 05:13:43 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-39d0a9a8-a7c3-4cdb-bb53-8cc0c33b8175 tempest-VolumesGetTest-84657810 None] Acquiring lock "cinder-83621b0c-0bed-4354-bc7f-5579a0f70367-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:43 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-39d0a9a8-a7c3-4cdb-bb53-8cc0c33b8175 tempest-VolumesGetTest-84657810 None] Lock "cinder-83621b0c-0bed-4354-bc7f-5579a0f70367-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:43 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-39d0a9a8-a7c3-4cdb-bb53-8cc0c33b8175 tempest-VolumesGetTest-84657810 None] Acquiring lock "cinder-quobyte-83621b0c-0bed-4354-bc7f-5579a0f70367" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:43 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-39d0a9a8-a7c3-4cdb-bb53-8cc0c33b8175 tempest-VolumesGetTest-84657810 None] Lock "cinder-quobyte-83621b0c-0bed-4354-bc7f-5579a0f70367" acquired by "delete_volume" :: waited 0.029s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:43 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[861a30d2-158e-45d8-8173-0c8973d820b1]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-39d0a9a8-a7c3-4cdb-bb53-8cc0c33b8175 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-83621b0c-0bed-4354-bc7f-5579a0f70367 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:43 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-83621b0c-0bed-4354-bc7f-5579a0f70367 Sep 05 05:13:43 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:43 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-39d0a9a8-a7c3-4cdb-bb53-8cc0c33b8175 tempest-VolumesGetTest-84657810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-83621b0c-0bed-4354-bc7f-5579a0f70367" returned: 0 in 0.427s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-39d0a9a8-a7c3-4cdb-bb53-8cc0c33b8175 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-83621b0c-0bed-4354-bc7f-5579a0f70367 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:43 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-83621b0c-0bed-4354-bc7f-5579a0f70367 Sep 05 05:13:43 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:44 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-39d0a9a8-a7c3-4cdb-bb53-8cc0c33b8175 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-83621b0c-0bed-4354-bc7f-5579a0f70367" returned: 0 in 0.256s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-39d0a9a8-a7c3-4cdb-bb53-8cc0c33b8175 tempest-VolumesGetTest-84657810 None] Lock "cinder-quobyte-83621b0c-0bed-4354-bc7f-5579a0f70367" released by "delete_volume" :: held 0.736s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-39d0a9a8-a7c3-4cdb-bb53-8cc0c33b8175 tempest-VolumesGetTest-84657810 None] Created reservations ['c157459a-8367-43d6-81bc-abdee09e7cdb', '19216899-6f66-4a38-86b2-eeff29a017ec', 'c6a0a115-208e-4d15-b520-42401a7e268e', '053326ee-56df-4800-b6cb-0d4a88946bd9'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-39d0a9a8-a7c3-4cdb-bb53-8cc0c33b8175 tempest-VolumesGetTest-84657810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-39d0a9a8-a7c3-4cdb-bb53-8cc0c33b8175 tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-39d0a9a8-a7c3-4cdb-bb53-8cc0c33b8175 tempest-VolumesGetTest-84657810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-39d0a9a8-a7c3-4cdb-bb53-8cc0c33b8175 tempest-VolumesGetTest-84657810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-39d0a9a8-a7c3-4cdb-bb53-8cc0c33b8175 tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-39d0a9a8-a7c3-4cdb-bb53-8cc0c33b8175 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:44 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:13:44 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:44 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-39d0a9a8-a7c3-4cdb-bb53-8cc0c33b8175 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.316s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-39d0a9a8-a7c3-4cdb-bb53-8cc0c33b8175 tempest-VolumesGetTest-84657810 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a09e286b-2914-4e22-b083-3776290fcb29 tempest-VolumesGetTest-84657810 None] Acquiring lock "cinder-0c9919a7-f5cd-4490-95af-7cea70b39e41-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:44 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-39d0a9a8-a7c3-4cdb-bb53-8cc0c33b8175 tempest-VolumesGetTest-84657810 None] Deleted volume successfully. Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a09e286b-2914-4e22-b083-3776290fcb29 tempest-VolumesGetTest-84657810 None] Lock "cinder-0c9919a7-f5cd-4490-95af-7cea70b39e41-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Flow 'volume_create_manager' (086d2290-a9bd-4ee0-9397-964f24f35a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e7c6957-ef8a-4ed1-802e-1a4ba1915b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-39d0a9a8-a7c3-4cdb-bb53-8cc0c33b8175 tempest-VolumesGetTest-84657810 None] Lock "cinder-83621b0c-0bed-4354-bc7f-5579a0f70367-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e7c6957-ef8a-4ed1-802e-1a4ba1915b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-279922559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51379d0f-a88c-4c73-a3e1-479e663acaba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21272056ddcf495ca5d18ae9602d1115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:13:45Z,use_quota=True,user_id='96d0ba2c3b774ae5a990a351bab3f667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b604e0ab-2d24-46f5-9a48-a4342ea280c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b604e0ab-2d24-46f5-9a48-a4342ea280c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f86ab2-8b90-41bc-9565-c121bd7e19d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG cinder.image.glance [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Creating Keystone auth plugin from conf {{(pid=89331) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a09e286b-2914-4e22-b083-3776290fcb29 tempest-VolumesGetTest-84657810 None] Acquiring lock "cinder-quobyte-0c9919a7-f5cd-4490-95af-7cea70b39e41" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a09e286b-2914-4e22-b083-3776290fcb29 tempest-VolumesGetTest-84657810 None] Lock "cinder-quobyte-0c9919a7-f5cd-4490-95af-7cea70b39e41" acquired by "delete_volume" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[75391c55-b2d0-4d16-8d42-c7855576469f]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a09e286b-2914-4e22-b083-3776290fcb29 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0c9919a7-f5cd-4490-95af-7cea70b39e41 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:44 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0c9919a7-f5cd-4490-95af-7cea70b39e41 Sep 05 05:13:44 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f86ab2-8b90-41bc-9565-c121bd7e19d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '51379d0f-a88c-4c73-a3e1-479e663acaba', 'volume_name': 'volume-51379d0f-a88c-4c73-a3e1-479e663acaba', 'volume_size': 1, 'image_id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '06b067117d184688bd2e16e21ff323f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'created_at': datetime.datetime(2026, 9, 5, 2, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 55, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e3957b-ef36-473c-bc72-dfbb33c04cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e3957b-ef36-473c-bc72-dfbb33c04cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee760986-2532-45e1-ba29-552707ec55bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:45 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Volume 51379d0f-a88c-4c73-a3e1-479e663acaba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-51379d0f-a88c-4c73-a3e1-479e663acaba', 'volume_size': 1, 'image_id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '06b067117d184688bd2e16e21ff323f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'created_at': datetime.datetime(2026, 9, 5, 2, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 55, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Trying to clone 51379d0f-a88c-4c73-a3e1-479e663acaba from image a60f4e58-9471-4dd7-bff3-114bdbd77a8d at location (None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}]). {{(pid=89331) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 05:13:45 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a09e286b-2914-4e22-b083-3776290fcb29 tempest-VolumesGetTest-84657810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0c9919a7-f5cd-4490-95af-7cea70b39e41" returned: 0 in 0.406s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a09e286b-2914-4e22-b083-3776290fcb29 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0c9919a7-f5cd-4490-95af-7cea70b39e41 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:45 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0c9919a7-f5cd-4490-95af-7cea70b39e41 Sep 05 05:13:45 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_w4g62suddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 05:13:45 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Image download 20.69 MB at 20.69 MB/s Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d441bb5c-fa96-4393-9ada-512df8c03760]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_w4g62suddevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:45 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a09e286b-2914-4e22-b083-3776290fcb29 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0c9919a7-f5cd-4490-95af-7cea70b39e41" returned: 0 in 0.390s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a09e286b-2914-4e22-b083-3776290fcb29 tempest-VolumesGetTest-84657810 None] Lock "cinder-quobyte-0c9919a7-f5cd-4490-95af-7cea70b39e41" released by "delete_volume" :: held 0.855s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:45 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_w4g62suddevstack@QuobyteHD Sep 05 05:13:45 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-a09e286b-2914-4e22-b083-3776290fcb29 tempest-VolumesGetTest-84657810 None] Created reservations ['4e14dbfa-b2cf-420f-8461-e675c29f5e3b', '0affecd9-e995-4d71-98a8-b9f377e2addc', '19be07ad-5ef8-4458-8e6c-b05b43f8cabc', '09694e5b-6d64-405b-acae-de70a3aa9fdc'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a09e286b-2914-4e22-b083-3776290fcb29 tempest-VolumesGetTest-84657810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a09e286b-2914-4e22-b083-3776290fcb29 tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a09e286b-2914-4e22-b083-3776290fcb29 tempest-VolumesGetTest-84657810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a09e286b-2914-4e22-b083-3776290fcb29 tempest-VolumesGetTest-84657810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a09e286b-2914-4e22-b083-3776290fcb29 tempest-VolumesGetTest-84657810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a09e286b-2914-4e22-b083-3776290fcb29 tempest-VolumesGetTest-84657810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:45 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:13:45 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:45 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_w4g62suddevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Temporary image a60f4e58-9471-4dd7-bff3-114bdbd77a8d is fetched for user 96d0ba2c3b774ae5a990a351bab3f667. {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b9ee21-6f81-43c4-84d9-e1b87bce8be7]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_w4g62suddevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:45 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a09e286b-2914-4e22-b083-3776290fcb29 tempest-VolumesGetTest-84657810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.256s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:46 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-a09e286b-2914-4e22-b083-3776290fcb29 tempest-VolumesGetTest-84657810 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:13:46 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-a09e286b-2914-4e22-b083-3776290fcb29 tempest-VolumesGetTest-84657810 None] Deleted volume successfully. Sep 05 05:13:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a09e286b-2914-4e22-b083-3776290fcb29 tempest-VolumesGetTest-84657810 None] Lock "cinder-0c9919a7-f5cd-4490-95af-7cea70b39e41-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:13:46 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_w4g62suddevstack@QuobyteHD Sep 05 05:13:46 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:46 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_w4g62suddevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:46 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-279922559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51379d0f-a88c-4c73-a3e1-479e663acaba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21272056ddcf495ca5d18ae9602d1115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:13:45Z,use_quota=True,user_id='96d0ba2c3b774ae5a990a351bab3f667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:13:46 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Creating volume 51379d0f-a88c-4c73-a3e1-479e663acaba {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:13:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:46 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:13:46 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:13:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:46 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:13:46 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:13:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-51379d0f-a88c-4c73-a3e1-479e663acaba 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:46 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-51379d0f-a88c-4c73-a3e1-479e663acaba 1073741824 Sep 05 05:13:46 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:46 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-51379d0f-a88c-4c73-a3e1-479e663acaba 1073741824" returned: 0 in 0.609s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-51379d0f-a88c-4c73-a3e1-479e663acaba {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:47 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-51379d0f-a88c-4c73-a3e1-479e663acaba Sep 05 05:13:47 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:47 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-51379d0f-a88c-4c73-a3e1-479e663acaba" returned: 0 in 0.309s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:13:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:47 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Attempting download of a60f4e58-9471-4dd7-bff3-114bdbd77a8d ((None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}])) to volume 51379d0f-a88c-4c73-a3e1-479e663acaba. {{(pid=89331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 05:13:47 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3514d1f-aa3e-44b7-a8e3-fbd5a10be028]: (4, 'raw') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_hmnncyex {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:47 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_hmnncyex Sep 05 05:13:47 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:47 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_hmnncyex" returned: 0 in 0.356s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_hmnncyex {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:47 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_hmnncyex Sep 05 05:13:47 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:48 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_hmnncyex" returned: 1 in 0.370s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_hmnncyex' failed. Not Retrying. {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 05:13:48 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7309f83a-40f6-4a09-ab4f-f54c31a7fa84]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:13:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_w4g62suddevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:48 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_w4g62suddevstack@QuobyteHD Sep 05 05:13:48 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:48 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_w4g62suddevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:48 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] a60f4e58-9471-4dd7-bff3-114bdbd77a8d was qcow2, converting to qcow2 {{(pid=89331) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 05:13:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_w4g62suddevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-51379d0f-a88c-4c73-a3e1-479e663acaba {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:48 devstack sudo[101873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_w4g62suddevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-51379d0f-a88c-4c73-a3e1-479e663acaba Sep 05 05:13:48 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:13:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:13:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:13:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:49 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:13:49 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:50 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.408s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:50 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:13:50 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager._thread_info {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:13:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread count: 29 {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 05:13:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread info: [<_MainThread(MainThread, started 139182109970560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 05:13:50 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_w4g62suddevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-51379d0f-a88c-4c73-a3e1-479e663acaba" returned: 0 in 2.173s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:50 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a60f4e58-9471-4dd7-bff3-114bdbd77a8d_w4g62suddevstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-51379d0f-a88c-4c73-a3e1-479e663acaba {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:13:50 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Converted 112.00 MB image at 51.51 MB/s Sep 05 05:13:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-51379d0f-a88c-4c73-a3e1-479e663acaba 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:13:50 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-51379d0f-a88c-4c73-a3e1-479e663acaba 1G Sep 05 05:13:50 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:13:51 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Sep 05 05:13:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-51379d0f-a88c-4c73-a3e1-479e663acaba 1G" returned: 0 in 0.414s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:13:51 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Downloaded image a60f4e58-9471-4dd7-bff3-114bdbd77a8d ((None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}])) to volume 51379d0f-a88c-4c73-a3e1-479e663acaba successfully. {{(pid=89331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 05:13:51 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Temporary image a60f4e58-9471-4dd7-bff3-114bdbd77a8d for user 96d0ba2c3b774ae5a990a351bab3f667 is deleted. {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 05:13:51 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Marking volume 51379d0f-a88c-4c73-a3e1-479e663acaba as bootable. {{(pid=89331) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 05:13:51 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Copying metadata from image a60f4e58-9471-4dd7-bff3-114bdbd77a8d to 51379d0f-a88c-4c73-a3e1-479e663acaba. {{(pid=89331) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 05:13:51 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Creating volume glance metadata for volume 51379d0f-a88c-4c73-a3e1-479e663acaba backed by image a60f4e58-9471-4dd7-bff3-114bdbd77a8d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89331) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 05:13:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee760986-2532-45e1-ba29-552707ec55bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51379d0f-a88c-4c73-a3e1-479e663acaba', 'volume_size': 1, 'image_id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '06b067117d184688bd2e16e21ff323f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a60f4e58-9471-4dd7-bff3-114bdbd77a8d', 'created_at': datetime.datetime(2026, 9, 5, 2, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 55, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a60f4e58-9471-4dd7-bff3-114bdbd77a8d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddabffdf-fa8f-4864-8f8d-a07df3e5cf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:13:51 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Volume volume-51379d0f-a88c-4c73-a3e1-479e663acaba (51379d0f-a88c-4c73-a3e1-479e663acaba): created successfully Sep 05 05:13:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddabffdf-fa8f-4864-8f8d-a07df3e5cf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:13:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Flow 'volume_create_manager' (086d2290-a9bd-4ee0-9397-964f24f35a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:13:51 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-4370fc36-ab74-48aa-b182-2ef5cc66e085 tempest-TestShelveInstance-217254441 None] Created volume successfully. Sep 05 05:13:57 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=106,cinder:INSERT=34,cinder:UPDATE=139,cinder:DELETE=11 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:13:57 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=96,cinder:INSERT=55,cinder:UPDATE=125,cinder:DELETE=10 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:13:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-d9b3bb14-15f1-4715-afd3-030eecda6046 req-c3fbdf35-6731-400d-b47d-2f473bf0781a tempest-TestShelveInstance-217254441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:13:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-d9b3bb14-15f1-4715-afd3-030eecda6046 req-c3fbdf35-6731-400d-b47d-2f473bf0781a tempest-TestShelveInstance-217254441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:13:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-d9b3bb14-15f1-4715-afd3-030eecda6046 req-c3fbdf35-6731-400d-b47d-2f473bf0781a tempest-TestShelveInstance-217254441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:13:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-d9b3bb14-15f1-4715-afd3-030eecda6046 req-c3fbdf35-6731-400d-b47d-2f473bf0781a tempest-TestShelveInstance-217254441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136', 'name': 'volume-51379d0f-a88c-4c73-a3e1-479e663acaba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1dc10c93-d08f-41ee-a700-82ecc8f65066', 'enforce_multipath': True} {{(pid=89331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 05:13:57 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-d9b3bb14-15f1-4715-afd3-030eecda6046 req-c3fbdf35-6731-400d-b47d-2f473bf0781a tempest-TestShelveInstance-217254441 None] attachment_update completed successfully. Sep 05 05:14:07 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:14:07 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=6 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:14:21 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:14:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Flow 'volume_create_manager' (6229889c-62f5-482f-8790-45e8ea8ee06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:14:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a616ca8c-b510-4889-8ce9-c65d1f84c278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a616ca8c-b510-4889-8ce9-c65d1f84c278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-679531996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6d4b7f-6e20-402a-b1fb-119b9b835730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55666ad42848477592135977f22a081a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:14:22Z,use_quota=True,user_id='e93bf5afc5294193a73e7c5ca24d33d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e9704f5-5b36-438c-8336-685967c00354),volume_type_id=0e9704f5-5b36-438c-8336-685967c00354)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f730f26-c90e-4592-8d24-c38fb377684a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f730f26-c90e-4592-8d24-c38fb377684a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cc672fb-4091-4b81-98da-427e3146a190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cc672fb-4091-4b81-98da-427e3146a190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a6d4b7f-6e20-402a-b1fb-119b9b835730', 'volume_name': 'volume-8a6d4b7f-6e20-402a-b1fb-119b9b835730', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7246be4-19ab-4530-a3d3-c40f3e2d1d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7246be4-19ab-4530-a3d3-c40f3e2d1d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd91fbe-97d5-4f9f-8e6c-5cbba3d3bf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:21 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Volume 8a6d4b7f-6e20-402a-b1fb-119b9b835730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a6d4b7f-6e20-402a-b1fb-119b9b835730', 'volume_size': 1} Sep 05 05:14:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:14:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:14:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-679531996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6d4b7f-6e20-402a-b1fb-119b9b835730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55666ad42848477592135977f22a081a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:14:22Z,use_quota=True,user_id='e93bf5afc5294193a73e7c5ca24d33d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e9704f5-5b36-438c-8336-685967c00354),volume_type_id=0e9704f5-5b36-438c-8336-685967c00354)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:14:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Creating volume 8a6d4b7f-6e20-402a-b1fb-119b9b835730 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:14:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:14:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:14:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:14:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:14:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:14:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:14:21 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:14:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a6d4b7f-6e20-402a-b1fb-119b9b835730 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:14:21 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a6d4b7f-6e20-402a-b1fb-119b9b835730 1073741824 Sep 05 05:14:21 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:14:22 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:14:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Flow 'volume_create_manager' (49985410-c0f6-4180-b895-bf256357e667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:14:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423e53d3-3fd5-4d3f-a609-1ff6da053edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423e53d3-3fd5-4d3f-a609-1ff6da053edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1066417981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0955251e-dd23-4fab-9193-f8c85ff42aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55666ad42848477592135977f22a081a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:14:22Z,use_quota=True,user_id='e93bf5afc5294193a73e7c5ca24d33d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f301a8c-6799-468d-bd33-edfd23de6377),volume_type_id=1f301a8c-6799-468d-bd33-edfd23de6377)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f3620a-4889-4c25-87f7-862731b3ef91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f3620a-4889-4c25-87f7-862731b3ef91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f930306b-c994-4dfa-bc28-99e2df04c9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f930306b-c994-4dfa-bc28-99e2df04c9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0955251e-dd23-4fab-9193-f8c85ff42aa6', 'volume_name': 'volume-0955251e-dd23-4fab-9193-f8c85ff42aa6', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (856216f0-f241-4dea-9741-920f9f815c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (856216f0-f241-4dea-9741-920f9f815c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce780cd4-8ea6-41c7-8d28-4dd70056b727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:22 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Volume 0955251e-dd23-4fab-9193-f8c85ff42aa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0955251e-dd23-4fab-9193-f8c85ff42aa6', 'volume_size': 1} Sep 05 05:14:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:14:22 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Sep 05 05:14:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a6d4b7f-6e20-402a-b1fb-119b9b835730 1073741824" returned: 0 in 0.723s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:14:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a6d4b7f-6e20-402a-b1fb-119b9b835730 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:14:22 devstack sudo[102530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a6d4b7f-6e20-402a-b1fb-119b9b835730 Sep 05 05:14:22 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:14:23 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a6d4b7f-6e20-402a-b1fb-119b9b835730" returned: 0 in 0.407s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.478s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1066417981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0955251e-dd23-4fab-9193-f8c85ff42aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55666ad42848477592135977f22a081a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:14:22Z,use_quota=True,user_id='e93bf5afc5294193a73e7c5ca24d33d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f301a8c-6799-468d-bd33-edfd23de6377),volume_type_id=1f301a8c-6799-468d-bd33-edfd23de6377)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Creating volume 0955251e-dd23-4fab-9193-f8c85ff42aa6 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:14:23 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0955251e-dd23-4fab-9193-f8c85ff42aa6 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd91fbe-97d5-4f9f-8e6c-5cbba3d3bf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a6d4b7f-6e20-402a-b1fb-119b9b835730', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:23 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0955251e-dd23-4fab-9193-f8c85ff42aa6 1073741824 Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c38855-9021-44a2-b0bc-10dd6f817706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:23 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:14:23 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Volume volume-8a6d4b7f-6e20-402a-b1fb-119b9b835730 (8a6d4b7f-6e20-402a-b1fb-119b9b835730): created successfully Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c38855-9021-44a2-b0bc-10dd6f817706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Flow 'volume_create_manager' (6229889c-62f5-482f-8790-45e8ea8ee06a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:14:23 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-03100b0d-411b-40f0-8714-1bf7efb06607 tempest-TestInstancesWithCinderVolumes-1103793311 None] Created volume successfully. Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Flow 'volume_create_manager' (35c3ab33-25b5-4b32-8964-8016c2c795f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6093e438-7d9d-4ea4-ae77-b9618300bf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6093e438-7d9d-4ea4-ae77-b9618300bf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1314097137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29495694-605d-4f20-9842-bdcb27968739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55666ad42848477592135977f22a081a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:14:23Z,use_quota=True,user_id='e93bf5afc5294193a73e7c5ca24d33d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f942c6a-4db6-4b27-afae-3231a8181523),volume_type_id=3f942c6a-4db6-4b27-afae-3231a8181523)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ca3ca2-38d2-4b82-a65f-7c1fcb68ac23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ca3ca2-38d2-4b82-a65f-7c1fcb68ac23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9eb8c49-0dd1-4ec4-9d31-dab366482cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG cinder.image.glance [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Creating Keystone auth plugin from conf {{(pid=89331) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9eb8c49-0dd1-4ec4-9d31-dab366482cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '29495694-605d-4f20-9842-bdcb27968739', 'volume_name': 'volume-29495694-605d-4f20-9842-bdcb27968739', 'volume_size': 1, 'image_id': '81beefd8-9322-4dee-9545-201c0b8b19af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81beefd8-9322-4dee-9545-201c0b8b19af', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--52212063', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55666ad42848477592135977f22a081a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81beefd8-9322-4dee-9545-201c0b8b19af', 'created_at': datetime.datetime(2026, 9, 5, 3, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 3, 14, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81beefd8-9322-4dee-9545-201c0b8b19af/file', 'properties': {}}, 'image_service': }' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (732c5c7a-874c-451c-8456-3ce7be846ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (732c5c7a-874c-451c-8456-3ce7be846ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb062d73-1956-41e9-a99f-efb922954c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:23 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Sep 05 05:14:23 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Volume 29495694-605d-4f20-9842-bdcb27968739: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-29495694-605d-4f20-9842-bdcb27968739', 'volume_size': 1, 'image_id': '81beefd8-9322-4dee-9545-201c0b8b19af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81beefd8-9322-4dee-9545-201c0b8b19af', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--52212063', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55666ad42848477592135977f22a081a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81beefd8-9322-4dee-9545-201c0b8b19af', 'created_at': datetime.datetime(2026, 9, 5, 3, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 3, 14, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81beefd8-9322-4dee-9545-201c0b8b19af/file', 'properties': {}}, 'image_service': } Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Trying to clone 29495694-605d-4f20-9842-bdcb27968739 from image 81beefd8-9322-4dee-9545-201c0b8b19af at location (None, [{'url': 'file:///opt/stack/data/glance/images/81beefd8-9322-4dee-9545-201c0b8b19af', 'metadata': {}}]). {{(pid=89331) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0955251e-dd23-4fab-9193-f8c85ff42aa6 1073741824" returned: 0 in 0.600s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:14:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0955251e-dd23-4fab-9193-f8c85ff42aa6 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:14:23 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0955251e-dd23-4fab-9193-f8c85ff42aa6 Sep 05 05:14:23 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:14:24 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Sep 05 05:14:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0955251e-dd23-4fab-9193-f8c85ff42aa6" returned: 0 in 0.290s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:14:24 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:14:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:14:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce780cd4-8ea6-41c7-8d28-4dd70056b727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0955251e-dd23-4fab-9193-f8c85ff42aa6', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3320d64-40bb-424f-8c89-5cb4b67f3990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:24 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Volume volume-0955251e-dd23-4fab-9193-f8c85ff42aa6 (0955251e-dd23-4fab-9193-f8c85ff42aa6): created successfully Sep 05 05:14:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3320d64-40bb-424f-8c89-5cb4b67f3990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Flow 'volume_create_manager' (49985410-c0f6-4180-b895-bf256357e667) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:14:24 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-5f75df9a-9d6b-480b-b410-e67b003b202f tempest-TestInstancesWithCinderVolumes-1103793311 None] Created volume successfully. Sep 05 05:14:26 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_81beefd8-9322-4dee-9545-201c0b8b19af_wzd5nz7mdevstack@QuobyteHD, size 20.69 MB, duration 3.02 sec {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 05:14:26 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Image download 20.69 MB at 6.85 MB/s Sep 05 05:14:26 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[34607d72-deb6-4e80-8617-28b295c74714]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:14:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81beefd8-9322-4dee-9545-201c0b8b19af_wzd5nz7mdevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:14:26 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81beefd8-9322-4dee-9545-201c0b8b19af_wzd5nz7mdevstack@QuobyteHD Sep 05 05:14:26 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:14:27 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Sep 05 05:14:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81beefd8-9322-4dee-9545-201c0b8b19af_wzd5nz7mdevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:14:27 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Temporary image 81beefd8-9322-4dee-9545-201c0b8b19af is fetched for user e93bf5afc5294193a73e7c5ca24d33d3. {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 05:14:27 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8516842e-35cf-46a1-b187-45eaeb59c5b1]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:14:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81beefd8-9322-4dee-9545-201c0b8b19af_wzd5nz7mdevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:14:27 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81beefd8-9322-4dee-9545-201c0b8b19af_wzd5nz7mdevstack@QuobyteHD Sep 05 05:14:27 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:14:27 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Sep 05 05:14:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81beefd8-9322-4dee-9545-201c0b8b19af_wzd5nz7mdevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:14:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:14:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:14:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1314097137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29495694-605d-4f20-9842-bdcb27968739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55666ad42848477592135977f22a081a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:14:23Z,use_quota=True,user_id='e93bf5afc5294193a73e7c5ca24d33d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f942c6a-4db6-4b27-afae-3231a8181523),volume_type_id=3f942c6a-4db6-4b27-afae-3231a8181523)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:14:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Creating volume 29495694-605d-4f20-9842-bdcb27968739 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:14:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:14:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:14:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:14:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:14:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:14:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:14:27 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:14:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-29495694-605d-4f20-9842-bdcb27968739 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:14:27 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-29495694-605d-4f20-9842-bdcb27968739 1073741824 Sep 05 05:14:27 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:14:27 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Sep 05 05:14:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-29495694-605d-4f20-9842-bdcb27968739 1073741824" returned: 0 in 0.404s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:14:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-29495694-605d-4f20-9842-bdcb27968739 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:14:27 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-29495694-605d-4f20-9842-bdcb27968739 Sep 05 05:14:27 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:14:28 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Sep 05 05:14:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-29495694-605d-4f20-9842-bdcb27968739" returned: 0 in 0.239s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:14:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:14:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:14:28 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Attempting download of 81beefd8-9322-4dee-9545-201c0b8b19af ((None, [{'url': 'file:///opt/stack/data/glance/images/81beefd8-9322-4dee-9545-201c0b8b19af', 'metadata': {}}])) to volume 29495694-605d-4f20-9842-bdcb27968739. {{(pid=89331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 05:14:28 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9995577-9674-4c5f-afd3-f2761c3c3ce8]: (4, 'raw') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:14:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81beefd8-9322-4dee-9545-201c0b8b19af_7ribt_v7 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:14:28 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81beefd8-9322-4dee-9545-201c0b8b19af_7ribt_v7 Sep 05 05:14:28 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:14:28 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Sep 05 05:14:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81beefd8-9322-4dee-9545-201c0b8b19af_7ribt_v7" returned: 0 in 0.329s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:14:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81beefd8-9322-4dee-9545-201c0b8b19af_7ribt_v7 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:14:28 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81beefd8-9322-4dee-9545-201c0b8b19af_7ribt_v7 Sep 05 05:14:28 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:14:28 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Sep 05 05:14:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81beefd8-9322-4dee-9545-201c0b8b19af_7ribt_v7" returned: 1 in 0.329s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:14:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81beefd8-9322-4dee-9545-201c0b8b19af_7ribt_v7' failed. Not Retrying. {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 05:14:28 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a0f84a-b9e0-4406-9e02-d277a895e3c4]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:14:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81beefd8-9322-4dee-9545-201c0b8b19af_wzd5nz7mdevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:14:29 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81beefd8-9322-4dee-9545-201c0b8b19af_wzd5nz7mdevstack@QuobyteHD Sep 05 05:14:29 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:14:29 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Sep 05 05:14:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_81beefd8-9322-4dee-9545-201c0b8b19af_wzd5nz7mdevstack@QuobyteHD" returned: 0 in 0.315s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:14:29 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] 81beefd8-9322-4dee-9545-201c0b8b19af was qcow2, converting to qcow2 {{(pid=89331) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 05:14:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81beefd8-9322-4dee-9545-201c0b8b19af_wzd5nz7mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-29495694-605d-4f20-9842-bdcb27968739 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:14:29 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81beefd8-9322-4dee-9545-201c0b8b19af_wzd5nz7mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-29495694-605d-4f20-9842-bdcb27968739 Sep 05 05:14:29 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:14:31 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Sep 05 05:14:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_81beefd8-9322-4dee-9545-201c0b8b19af_wzd5nz7mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-29495694-605d-4f20-9842-bdcb27968739" returned: 0 in 1.862s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:14:31 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_81beefd8-9322-4dee-9545-201c0b8b19af_wzd5nz7mdevstack@QuobyteHD, size 112.00 MB, duration 1.86 sec, destination /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-29495694-605d-4f20-9842-bdcb27968739 {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:14:31 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Converted 112.00 MB image at 60.12 MB/s Sep 05 05:14:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-29495694-605d-4f20-9842-bdcb27968739 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:14:31 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-29495694-605d-4f20-9842-bdcb27968739 1G Sep 05 05:14:31 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:14:31 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Sep 05 05:14:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-29495694-605d-4f20-9842-bdcb27968739 1G" returned: 0 in 0.336s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:14:31 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Downloaded image 81beefd8-9322-4dee-9545-201c0b8b19af ((None, [{'url': 'file:///opt/stack/data/glance/images/81beefd8-9322-4dee-9545-201c0b8b19af', 'metadata': {}}])) to volume 29495694-605d-4f20-9842-bdcb27968739 successfully. {{(pid=89331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 05:14:31 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Temporary image 81beefd8-9322-4dee-9545-201c0b8b19af for user e93bf5afc5294193a73e7c5ca24d33d3 is deleted. {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 05:14:31 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Marking volume 29495694-605d-4f20-9842-bdcb27968739 as bootable. {{(pid=89331) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 05:14:31 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Copying metadata from image 81beefd8-9322-4dee-9545-201c0b8b19af to 29495694-605d-4f20-9842-bdcb27968739. {{(pid=89331) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 05:14:31 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Creating volume glance metadata for volume 29495694-605d-4f20-9842-bdcb27968739 backed by image 81beefd8-9322-4dee-9545-201c0b8b19af with: {'image_id': '81beefd8-9322-4dee-9545-201c0b8b19af', 'image_name': 'tempest-scenario-img--52212063', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89331) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 05:14:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb062d73-1956-41e9-a99f-efb922954c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29495694-605d-4f20-9842-bdcb27968739', 'volume_size': 1, 'image_id': '81beefd8-9322-4dee-9545-201c0b8b19af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81beefd8-9322-4dee-9545-201c0b8b19af', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--52212063', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55666ad42848477592135977f22a081a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '81beefd8-9322-4dee-9545-201c0b8b19af', 'created_at': datetime.datetime(2026, 9, 5, 3, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 3, 14, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81beefd8-9322-4dee-9545-201c0b8b19af/file', 'properties': {}}, 'image_service': }' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dacccce-f726-4a87-9270-cc6a12df3c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:31 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Volume volume-29495694-605d-4f20-9842-bdcb27968739 (29495694-605d-4f20-9842-bdcb27968739): created successfully Sep 05 05:14:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dacccce-f726-4a87-9270-cc6a12df3c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Flow 'volume_create_manager' (35c3ab33-25b5-4b32-8964-8016c2c795f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:14:31 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-6639324c-d5b1-4618-b7ae-3fed7406f73c tempest-TestInstancesWithCinderVolumes-1103793311 None] Created volume successfully. Sep 05 05:14:34 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-cb2f70d3-46cd-4df5-91cb-ea8d809df77b req-e0029e89-47df-467a-a7c6-4b3155284171 tempest-TestShelveInstance-217254441 None] Terminate volume connection completed successfully. Sep 05 05:14:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-cb2f70d3-46cd-4df5-91cb-ea8d809df77b req-e0029e89-47df-467a-a7c6-4b3155284171 tempest-TestShelveInstance-217254441 None] Deleting attachment 1dc10c93-d08f-41ee-a700-82ecc8f65066. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:14:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-c2b40d22-33a6-49f0-ae1b-f6d23795d588 req-2ef33b44-e658-4002-9be8-7d81035fc05d tempest-TestInstancesWithCinderVolumes-1103793311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:14:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-c2b40d22-33a6-49f0-ae1b-f6d23795d588 req-2ef33b44-e658-4002-9be8-7d81035fc05d tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:14:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-c2b40d22-33a6-49f0-ae1b-f6d23795d588 req-2ef33b44-e658-4002-9be8-7d81035fc05d tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:14:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-c2b40d22-33a6-49f0-ae1b-f6d23795d588 req-2ef33b44-e658-4002-9be8-7d81035fc05d tempest-TestInstancesWithCinderVolumes-1103793311 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136', 'name': 'volume-29495694-605d-4f20-9842-bdcb27968739', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e35d70b3-3bd5-4f70-9edd-0009e61d2747', 'enforce_multipath': True} {{(pid=89331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 05:14:35 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-c2b40d22-33a6-49f0-ae1b-f6d23795d588 req-2ef33b44-e658-4002-9be8-7d81035fc05d tempest-TestInstancesWithCinderVolumes-1103793311 None] attachment_update completed successfully. Sep 05 05:14:36 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:14:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Flow 'volume_create_manager' (5ff366aa-6410-4073-b319-05e613683d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:14:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d7afbc-6eb5-49cb-aa1b-c90481ff79a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d7afbc-6eb5-49cb-aa1b-c90481ff79a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1049301043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a88984-59e6-4b2b-9a20-98035457358f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a682acde273148baa05230e2564b21b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:14:37Z,use_quota=True,user_id='31a6551b1f75425c817700fe876192b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ad86e6-77ee-46c3-aa2d-abbd6cf4104b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ad86e6-77ee-46c3-aa2d-abbd6cf4104b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736dfad4-7dd2-483a-b97a-d2fe11289488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736dfad4-7dd2-483a-b97a-d2fe11289488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45a88984-59e6-4b2b-9a20-98035457358f', 'volume_name': 'volume-45a88984-59e6-4b2b-9a20-98035457358f', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c111e6ab-8218-495e-8475-0b7f450668d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c111e6ab-8218-495e-8475-0b7f450668d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46076ad9-7020-4c86-83c7-66264a324b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:36 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Volume 45a88984-59e6-4b2b-9a20-98035457358f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45a88984-59e6-4b2b-9a20-98035457358f', 'volume_size': 1} Sep 05 05:14:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:14:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:14:36 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1049301043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a88984-59e6-4b2b-9a20-98035457358f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a682acde273148baa05230e2564b21b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:14:37Z,use_quota=True,user_id='31a6551b1f75425c817700fe876192b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:14:36 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Creating volume 45a88984-59e6-4b2b-9a20-98035457358f {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:14:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:14:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:14:36 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:14:36 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:14:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:14:36 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:14:36 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:14:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-45a88984-59e6-4b2b-9a20-98035457358f 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:14:36 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-45a88984-59e6-4b2b-9a20-98035457358f 1073741824 Sep 05 05:14:36 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:14:37 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Sep 05 05:14:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-45a88984-59e6-4b2b-9a20-98035457358f 1073741824" returned: 0 in 0.529s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:14:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-45a88984-59e6-4b2b-9a20-98035457358f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:14:37 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-45a88984-59e6-4b2b-9a20-98035457358f Sep 05 05:14:37 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:14:37 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Sep 05 05:14:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-45a88984-59e6-4b2b-9a20-98035457358f" returned: 0 in 0.360s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:14:37 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:14:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:14:37 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46076ad9-7020-4c86-83c7-66264a324b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45a88984-59e6-4b2b-9a20-98035457358f', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:37 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0f7b17-2080-4dc4-8753-861c4e8d5817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:14:37 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Volume volume-45a88984-59e6-4b2b-9a20-98035457358f (45a88984-59e6-4b2b-9a20-98035457358f): created successfully Sep 05 05:14:37 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0f7b17-2080-4dc4-8753-861c4e8d5817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:14:37 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Flow 'volume_create_manager' (5ff366aa-6410-4073-b319-05e613683d71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:14:37 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-9594c2d1-657d-4a6c-820c-692329afe014 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Created volume successfully. Sep 05 05:14:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-2bd0c581-2e4f-4c50-bd2f-e2293a201017 req-c1650cdf-a502-4ecf-805a-b95d2e43f27f tempest-TestShelveInstance-217254441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:14:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-2bd0c581-2e4f-4c50-bd2f-e2293a201017 req-c1650cdf-a502-4ecf-805a-b95d2e43f27f tempest-TestShelveInstance-217254441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:14:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-2bd0c581-2e4f-4c50-bd2f-e2293a201017 req-c1650cdf-a502-4ecf-805a-b95d2e43f27f tempest-TestShelveInstance-217254441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:14:38 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-2bd0c581-2e4f-4c50-bd2f-e2293a201017 req-c1650cdf-a502-4ecf-805a-b95d2e43f27f tempest-TestShelveInstance-217254441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136', 'name': 'volume-51379d0f-a88c-4c73-a3e1-479e663acaba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2318977b-7cd1-4da0-b5e0-791b9f0c5870', 'enforce_multipath': True} {{(pid=89331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 05:14:38 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-2bd0c581-2e4f-4c50-bd2f-e2293a201017 req-c1650cdf-a502-4ecf-805a-b95d2e43f27f tempest-TestShelveInstance-217254441 None] attachment_update completed successfully. Sep 05 05:14:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-0f3a6628-4317-4c47-b720-f6cd87b39285 req-85caf750-7a6a-4c3e-9b09-3549600169d4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:14:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-0f3a6628-4317-4c47-b720-f6cd87b39285 req-85caf750-7a6a-4c3e-9b09-3549600169d4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:14:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-0f3a6628-4317-4c47-b720-f6cd87b39285 req-85caf750-7a6a-4c3e-9b09-3549600169d4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:14:40 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-0f3a6628-4317-4c47-b720-f6cd87b39285 req-85caf750-7a6a-4c3e-9b09-3549600169d4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136', 'name': 'volume-45a88984-59e6-4b2b-9a20-98035457358f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e8a5f8a-fa4e-4102-b910-eee630acfe0d', 'enforce_multipath': True} {{(pid=89331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 05:14:40 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-0f3a6628-4317-4c47-b720-f6cd87b39285 req-85caf750-7a6a-4c3e-9b09-3549600169d4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] attachment_update completed successfully. Sep 05 05:14:45 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-e413c1a8-72ad-4f17-a813-f7e36a70ac2c req-170e52c4-abaf-44cf-ba42-80109eec9a2f tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Terminate volume connection completed successfully. Sep 05 05:14:45 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-e413c1a8-72ad-4f17-a813-f7e36a70ac2c req-170e52c4-abaf-44cf-ba42-80109eec9a2f tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Deleting attachment 7e8a5f8a-fa4e-4102-b910-eee630acfe0d. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:14:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-81e41196-796a-4325-a3d8-50f52869d7f4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Acquiring lock "cinder-45a88984-59e6-4b2b-9a20-98035457358f-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:14:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-81e41196-796a-4325-a3d8-50f52869d7f4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Lock "cinder-45a88984-59e6-4b2b-9a20-98035457358f-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:14:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-81e41196-796a-4325-a3d8-50f52869d7f4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Acquiring lock "cinder-quobyte-45a88984-59e6-4b2b-9a20-98035457358f" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:14:47 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-81e41196-796a-4325-a3d8-50f52869d7f4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Lock "cinder-quobyte-45a88984-59e6-4b2b-9a20-98035457358f" acquired by "delete_volume" :: waited 0.030s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:14:47 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2518230-155f-4e01-809e-336f95bba50d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:14:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-81e41196-796a-4325-a3d8-50f52869d7f4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-45a88984-59e6-4b2b-9a20-98035457358f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:14:47 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-45a88984-59e6-4b2b-9a20-98035457358f Sep 05 05:14:47 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:14:47 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Sep 05 05:14:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-81e41196-796a-4325-a3d8-50f52869d7f4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-45a88984-59e6-4b2b-9a20-98035457358f" returned: 0 in 0.515s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:14:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-81e41196-796a-4325-a3d8-50f52869d7f4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-45a88984-59e6-4b2b-9a20-98035457358f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:14:47 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-45a88984-59e6-4b2b-9a20-98035457358f Sep 05 05:14:47 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:14:47 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Sep 05 05:14:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-81e41196-796a-4325-a3d8-50f52869d7f4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-45a88984-59e6-4b2b-9a20-98035457358f" returned: 0 in 0.342s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:14:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-81e41196-796a-4325-a3d8-50f52869d7f4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Lock "cinder-quobyte-45a88984-59e6-4b2b-9a20-98035457358f" released by "delete_volume" :: held 0.988s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:14:48 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-81e41196-796a-4325-a3d8-50f52869d7f4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Created reservations ['831ed1cf-cabb-4135-90ac-438143571aae', 'ef2ae73f-cad6-49b7-8451-2157baf636d1', '4439a4b1-62af-4ff3-9086-ebca5df5611b', '2bd6d694-c88a-410d-be0d-63183387e67b'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:14:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-81e41196-796a-4325-a3d8-50f52869d7f4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:14:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-81e41196-796a-4325-a3d8-50f52869d7f4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:14:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-81e41196-796a-4325-a3d8-50f52869d7f4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:14:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-81e41196-796a-4325-a3d8-50f52869d7f4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:14:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-81e41196-796a-4325-a3d8-50f52869d7f4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:14:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-81e41196-796a-4325-a3d8-50f52869d7f4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:14:48 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:14:48 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:14:48 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Sep 05 05:14:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-81e41196-796a-4325-a3d8-50f52869d7f4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.363s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:14:48 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-81e41196-796a-4325-a3d8-50f52869d7f4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:14:48 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-81e41196-796a-4325-a3d8-50f52869d7f4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Deleted volume successfully. Sep 05 05:14:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-81e41196-796a-4325-a3d8-50f52869d7f4 tempest-TestServerVolumeAttachScenarioOldVersion-836597363 None] Lock "cinder-45a88984-59e6-4b2b-9a20-98035457358f-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:14:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:14:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:14:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:14:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:14:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:14:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:14:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:14:49 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:14:49 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:14:50 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Sep 05 05:14:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.454s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:14:50 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:14:50 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager._thread_info {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:14:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread count: 29 {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 05:14:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread info: [<_MainThread(MainThread, started 139182109970560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 05:14:58 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=40,cinder:UPDATE=32,cinder:INSERT=8,cinder:DELETE=2 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:14:58 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:UPDATE=21,cinder:SELECT=41,cinder:DELETE=3,cinder:INSERT=9 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:15:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-9c40c3cd-722b-4854-8bbf-f08c00b17d51 req-c9a57221-5763-4b8b-a571-c380e97a884e tempest-TestInstancesWithCinderVolumes-1103793311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-9c40c3cd-722b-4854-8bbf-f08c00b17d51 req-c9a57221-5763-4b8b-a571-c380e97a884e tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-9c40c3cd-722b-4854-8bbf-f08c00b17d51 req-c9a57221-5763-4b8b-a571-c380e97a884e tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-9c40c3cd-722b-4854-8bbf-f08c00b17d51 req-c9a57221-5763-4b8b-a571-c380e97a884e tempest-TestInstancesWithCinderVolumes-1103793311 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136', 'name': 'volume-8a6d4b7f-6e20-402a-b1fb-119b9b835730', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1e9b0d58-ea30-43c3-8c73-c8f515d76dad', 'enforce_multipath': True} {{(pid=89331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 05:15:13 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-9c40c3cd-722b-4854-8bbf-f08c00b17d51 req-c9a57221-5763-4b8b-a571-c380e97a884e tempest-TestInstancesWithCinderVolumes-1103793311 None] attachment_update completed successfully. Sep 05 05:15:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-a0284ed2-5ac7-443c-b66c-3c244e6a8b7f req-49a7ecf0-fdf0-413b-aefb-a2f8d5aa44c6 tempest-TestInstancesWithCinderVolumes-1103793311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-a0284ed2-5ac7-443c-b66c-3c244e6a8b7f req-49a7ecf0-fdf0-413b-aefb-a2f8d5aa44c6 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-a0284ed2-5ac7-443c-b66c-3c244e6a8b7f req-49a7ecf0-fdf0-413b-aefb-a2f8d5aa44c6 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:15 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-a0284ed2-5ac7-443c-b66c-3c244e6a8b7f req-49a7ecf0-fdf0-413b-aefb-a2f8d5aa44c6 tempest-TestInstancesWithCinderVolumes-1103793311 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136', 'name': 'volume-0955251e-dd23-4fab-9193-f8c85ff42aa6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98defc6e-7e87-41bc-9baf-872cf56d53e5', 'enforce_multipath': True} {{(pid=89331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 05:15:15 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-a0284ed2-5ac7-443c-b66c-3c244e6a8b7f req-49a7ecf0-fdf0-413b-aefb-a2f8d5aa44c6 tempest-TestInstancesWithCinderVolumes-1103793311 None] attachment_update completed successfully. Sep 05 05:15:20 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-f48540f3-341b-4f87-bc13-b180ee853c63 req-ee2162fc-e7c0-42bd-8f2b-363352a7e630 tempest-TestInstancesWithCinderVolumes-1103793311 None] Terminate volume connection completed successfully. Sep 05 05:15:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-f48540f3-341b-4f87-bc13-b180ee853c63 req-ee2162fc-e7c0-42bd-8f2b-363352a7e630 tempest-TestInstancesWithCinderVolumes-1103793311 None] Deleting attachment 1e9b0d58-ea30-43c3-8c73-c8f515d76dad. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:15:21 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-08d00dd6-6892-4c18-abfc-329ab1b1a890 tempest-TestInstancesWithCinderVolumes-1103793311 None] Acquiring lock "cinder-8a6d4b7f-6e20-402a-b1fb-119b9b835730-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:15:21 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-08d00dd6-6892-4c18-abfc-329ab1b1a890 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "cinder-8a6d4b7f-6e20-402a-b1fb-119b9b835730-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:15:21 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-08d00dd6-6892-4c18-abfc-329ab1b1a890 tempest-TestInstancesWithCinderVolumes-1103793311 None] Acquiring lock "cinder-quobyte-8a6d4b7f-6e20-402a-b1fb-119b9b835730" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:15:21 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-08d00dd6-6892-4c18-abfc-329ab1b1a890 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "cinder-quobyte-8a6d4b7f-6e20-402a-b1fb-119b9b835730" acquired by "delete_volume" :: waited 0.015s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:15:21 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92f1bf8-acf0-492e-a432-6b623e2720b0]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:15:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-08d00dd6-6892-4c18-abfc-329ab1b1a890 tempest-TestInstancesWithCinderVolumes-1103793311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a6d4b7f-6e20-402a-b1fb-119b9b835730 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:21 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a6d4b7f-6e20-402a-b1fb-119b9b835730 Sep 05 05:15:21 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:21 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-08d00dd6-6892-4c18-abfc-329ab1b1a890 tempest-TestInstancesWithCinderVolumes-1103793311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a6d4b7f-6e20-402a-b1fb-119b9b835730" returned: 0 in 0.442s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-08d00dd6-6892-4c18-abfc-329ab1b1a890 tempest-TestInstancesWithCinderVolumes-1103793311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a6d4b7f-6e20-402a-b1fb-119b9b835730 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:21 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a6d4b7f-6e20-402a-b1fb-119b9b835730 Sep 05 05:15:21 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:22 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-08d00dd6-6892-4c18-abfc-329ab1b1a890 tempest-TestInstancesWithCinderVolumes-1103793311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8a6d4b7f-6e20-402a-b1fb-119b9b835730" returned: 0 in 0.254s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:22 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-08d00dd6-6892-4c18-abfc-329ab1b1a890 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "cinder-quobyte-8a6d4b7f-6e20-402a-b1fb-119b9b835730" released by "delete_volume" :: held 0.748s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:15:22 devstack cinder-volume[89331]: WARNING cinder.quota [None req-08d00dd6-6892-4c18-abfc-329ab1b1a890 tempest-TestInstancesWithCinderVolumes-1103793311 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1856782144-670928966 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1856782144-670928966, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:15:22 devstack cinder-volume[89331]: WARNING cinder.quota [None req-08d00dd6-6892-4c18-abfc-329ab1b1a890 tempest-TestInstancesWithCinderVolumes-1103793311 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1856782144-670928966 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1856782144-670928966, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:15:22 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-08d00dd6-6892-4c18-abfc-329ab1b1a890 tempest-TestInstancesWithCinderVolumes-1103793311 None] Created reservations ['1d5c94bb-1bf8-48aa-b058-8c39e253f2b2', 'cfbc4b43-a211-402e-aca3-92758d5d0d3b', 'c1d26158-cb49-467c-8a7e-dd822d520b6f', '4903e77a-deae-4bee-97fe-0fdb2eba5a62'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:15:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-08d00dd6-6892-4c18-abfc-329ab1b1a890 tempest-TestInstancesWithCinderVolumes-1103793311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-08d00dd6-6892-4c18-abfc-329ab1b1a890 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-08d00dd6-6892-4c18-abfc-329ab1b1a890 tempest-TestInstancesWithCinderVolumes-1103793311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:15:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-08d00dd6-6892-4c18-abfc-329ab1b1a890 tempest-TestInstancesWithCinderVolumes-1103793311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:15:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-08d00dd6-6892-4c18-abfc-329ab1b1a890 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-08d00dd6-6892-4c18-abfc-329ab1b1a890 tempest-TestInstancesWithCinderVolumes-1103793311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:22 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:15:22 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:22 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-08d00dd6-6892-4c18-abfc-329ab1b1a890 tempest-TestInstancesWithCinderVolumes-1103793311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.283s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:22 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-08d00dd6-6892-4c18-abfc-329ab1b1a890 tempest-TestInstancesWithCinderVolumes-1103793311 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:15:22 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-08d00dd6-6892-4c18-abfc-329ab1b1a890 tempest-TestInstancesWithCinderVolumes-1103793311 None] Deleted volume successfully. Sep 05 05:15:22 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-08d00dd6-6892-4c18-abfc-329ab1b1a890 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "cinder-8a6d4b7f-6e20-402a-b1fb-119b9b835730-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:15:25 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-c32c978d-9d33-48d3-ace0-27f72cfaabbb req-7616d70f-6f37-47f0-becb-c666d4522e77 tempest-TestInstancesWithCinderVolumes-1103793311 None] Terminate volume connection completed successfully. Sep 05 05:15:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-c32c978d-9d33-48d3-ace0-27f72cfaabbb req-7616d70f-6f37-47f0-becb-c666d4522e77 tempest-TestInstancesWithCinderVolumes-1103793311 None] Deleting attachment 98defc6e-7e87-41bc-9baf-872cf56d53e5. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:15:26 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-9b246e1c-07cc-4653-9488-4a5146a3c4e6 req-36f01638-90b3-41a0-bbed-51e4018bab7c tempest-TestShelveInstance-217254441 None] Terminate volume connection completed successfully. Sep 05 05:15:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-9b246e1c-07cc-4653-9488-4a5146a3c4e6 req-36f01638-90b3-41a0-bbed-51e4018bab7c tempest-TestShelveInstance-217254441 None] Deleting attachment 2318977b-7cd1-4da0-b5e0-791b9f0c5870. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:15:26 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-9b246e1c-07cc-4653-9488-4a5146a3c4e6 req-912b8a19-8328-40e1-a26d-9d12ddac66b6 tempest-TestShelveInstance-217254441 None] Acquiring lock "cinder-51379d0f-a88c-4c73-a3e1-479e663acaba-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:15:26 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7f3db645-21ab-44d4-bb21-4c51343ea1c1 tempest-TestInstancesWithCinderVolumes-1103793311 None] Acquiring lock "cinder-0955251e-dd23-4fab-9193-f8c85ff42aa6-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:15:26 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-9b246e1c-07cc-4653-9488-4a5146a3c4e6 req-912b8a19-8328-40e1-a26d-9d12ddac66b6 tempest-TestShelveInstance-217254441 None] Lock "cinder-51379d0f-a88c-4c73-a3e1-479e663acaba-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:15:26 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7f3db645-21ab-44d4-bb21-4c51343ea1c1 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "cinder-0955251e-dd23-4fab-9193-f8c85ff42aa6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:15:26 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-9b246e1c-07cc-4653-9488-4a5146a3c4e6 req-912b8a19-8328-40e1-a26d-9d12ddac66b6 tempest-TestShelveInstance-217254441 None] Acquiring lock "cinder-quobyte-51379d0f-a88c-4c73-a3e1-479e663acaba" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:15:26 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-9b246e1c-07cc-4653-9488-4a5146a3c4e6 req-912b8a19-8328-40e1-a26d-9d12ddac66b6 tempest-TestShelveInstance-217254441 None] Lock "cinder-quobyte-51379d0f-a88c-4c73-a3e1-479e663acaba" acquired by "delete_volume" :: waited 0.028s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:15:26 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7f3db645-21ab-44d4-bb21-4c51343ea1c1 tempest-TestInstancesWithCinderVolumes-1103793311 None] Acquiring lock "cinder-quobyte-0955251e-dd23-4fab-9193-f8c85ff42aa6" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:15:26 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7f3db645-21ab-44d4-bb21-4c51343ea1c1 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "cinder-quobyte-0955251e-dd23-4fab-9193-f8c85ff42aa6" acquired by "delete_volume" :: waited 0.026s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:15:26 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a504188d-a985-49dc-9dca-36d28f8d76db]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:15:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-9b246e1c-07cc-4653-9488-4a5146a3c4e6 req-912b8a19-8328-40e1-a26d-9d12ddac66b6 tempest-TestShelveInstance-217254441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-51379d0f-a88c-4c73-a3e1-479e663acaba {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:26 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75ac252-6281-4726-a047-595c291acc41]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:15:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7f3db645-21ab-44d4-bb21-4c51343ea1c1 tempest-TestInstancesWithCinderVolumes-1103793311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0955251e-dd23-4fab-9193-f8c85ff42aa6 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:26 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-51379d0f-a88c-4c73-a3e1-479e663acaba Sep 05 05:15:26 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:26 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0955251e-dd23-4fab-9193-f8c85ff42aa6 Sep 05 05:15:26 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:27 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7f3db645-21ab-44d4-bb21-4c51343ea1c1 tempest-TestInstancesWithCinderVolumes-1103793311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0955251e-dd23-4fab-9193-f8c85ff42aa6" returned: 0 in 0.546s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7f3db645-21ab-44d4-bb21-4c51343ea1c1 tempest-TestInstancesWithCinderVolumes-1103793311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0955251e-dd23-4fab-9193-f8c85ff42aa6 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:27 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-9b246e1c-07cc-4653-9488-4a5146a3c4e6 req-912b8a19-8328-40e1-a26d-9d12ddac66b6 tempest-TestShelveInstance-217254441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-51379d0f-a88c-4c73-a3e1-479e663acaba" returned: 0 in 0.622s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-9b246e1c-07cc-4653-9488-4a5146a3c4e6 req-912b8a19-8328-40e1-a26d-9d12ddac66b6 tempest-TestShelveInstance-217254441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-51379d0f-a88c-4c73-a3e1-479e663acaba {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:27 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0955251e-dd23-4fab-9193-f8c85ff42aa6 Sep 05 05:15:27 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:27 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-51379d0f-a88c-4c73-a3e1-479e663acaba Sep 05 05:15:27 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:27 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7f3db645-21ab-44d4-bb21-4c51343ea1c1 tempest-TestInstancesWithCinderVolumes-1103793311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0955251e-dd23-4fab-9193-f8c85ff42aa6" returned: 0 in 0.452s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7f3db645-21ab-44d4-bb21-4c51343ea1c1 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "cinder-quobyte-0955251e-dd23-4fab-9193-f8c85ff42aa6" released by "delete_volume" :: held 1.072s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:15:27 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-9b246e1c-07cc-4653-9488-4a5146a3c4e6 req-912b8a19-8328-40e1-a26d-9d12ddac66b6 tempest-TestShelveInstance-217254441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-51379d0f-a88c-4c73-a3e1-479e663acaba" returned: 0 in 0.443s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-9b246e1c-07cc-4653-9488-4a5146a3c4e6 req-912b8a19-8328-40e1-a26d-9d12ddac66b6 tempest-TestShelveInstance-217254441 None] Lock "cinder-quobyte-51379d0f-a88c-4c73-a3e1-479e663acaba" released by "delete_volume" :: held 1.175s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:15:27 devstack cinder-volume[89331]: WARNING cinder.quota [None req-7f3db645-21ab-44d4-bb21-4c51343ea1c1 tempest-TestInstancesWithCinderVolumes-1103793311 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1785034135-785644724 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1785034135-785644724, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:15:27 devstack cinder-volume[89331]: WARNING cinder.quota [None req-7f3db645-21ab-44d4-bb21-4c51343ea1c1 tempest-TestInstancesWithCinderVolumes-1103793311 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1785034135-785644724 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1785034135-785644724, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:15:27 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-7f3db645-21ab-44d4-bb21-4c51343ea1c1 tempest-TestInstancesWithCinderVolumes-1103793311 None] Created reservations ['503e81de-b6f3-474e-90bd-ac0bb2f7aad4', '25698ecb-d224-40f9-813b-d5d23007dc65', 'ac2a4cd4-2e00-433a-86ce-392e25c99261', '023ffc53-5547-4d86-a856-b7ad58835c04'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:15:27 devstack cinder-volume[89331]: DEBUG cinder.quota [req-9b246e1c-07cc-4653-9488-4a5146a3c4e6 req-912b8a19-8328-40e1-a26d-9d12ddac66b6 tempest-TestShelveInstance-217254441 None] Created reservations ['4d81bdb5-e20d-4142-baba-80b9d991575d', '23c24f77-00e9-4525-995a-c45cd5db7e74', '76964400-1771-41c7-9701-795e2605145f', '6e6e92cf-534d-401e-8252-a152f44b1c33'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:15:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7f3db645-21ab-44d4-bb21-4c51343ea1c1 tempest-TestInstancesWithCinderVolumes-1103793311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7f3db645-21ab-44d4-bb21-4c51343ea1c1 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7f3db645-21ab-44d4-bb21-4c51343ea1c1 tempest-TestInstancesWithCinderVolumes-1103793311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:15:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7f3db645-21ab-44d4-bb21-4c51343ea1c1 tempest-TestInstancesWithCinderVolumes-1103793311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:15:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7f3db645-21ab-44d4-bb21-4c51343ea1c1 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7f3db645-21ab-44d4-bb21-4c51343ea1c1 tempest-TestInstancesWithCinderVolumes-1103793311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:27 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:15:27 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-9b246e1c-07cc-4653-9488-4a5146a3c4e6 req-912b8a19-8328-40e1-a26d-9d12ddac66b6 tempest-TestShelveInstance-217254441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-9b246e1c-07cc-4653-9488-4a5146a3c4e6 req-912b8a19-8328-40e1-a26d-9d12ddac66b6 tempest-TestShelveInstance-217254441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [req-9b246e1c-07cc-4653-9488-4a5146a3c4e6 req-912b8a19-8328-40e1-a26d-9d12ddac66b6 tempest-TestShelveInstance-217254441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:15:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [req-9b246e1c-07cc-4653-9488-4a5146a3c4e6 req-912b8a19-8328-40e1-a26d-9d12ddac66b6 tempest-TestShelveInstance-217254441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:15:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-9b246e1c-07cc-4653-9488-4a5146a3c4e6 req-912b8a19-8328-40e1-a26d-9d12ddac66b6 tempest-TestShelveInstance-217254441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-9b246e1c-07cc-4653-9488-4a5146a3c4e6 req-912b8a19-8328-40e1-a26d-9d12ddac66b6 tempest-TestShelveInstance-217254441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:27 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:15:27 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:28 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [req-9b246e1c-07cc-4653-9488-4a5146a3c4e6 req-912b8a19-8328-40e1-a26d-9d12ddac66b6 tempest-TestShelveInstance-217254441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.339s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:28 devstack cinder-volume[89331]: DEBUG cinder.manager [req-9b246e1c-07cc-4653-9488-4a5146a3c4e6 req-912b8a19-8328-40e1-a26d-9d12ddac66b6 tempest-TestShelveInstance-217254441 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:15:28 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7f3db645-21ab-44d4-bb21-4c51343ea1c1 tempest-TestInstancesWithCinderVolumes-1103793311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.417s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:28 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-7f3db645-21ab-44d4-bb21-4c51343ea1c1 tempest-TestInstancesWithCinderVolumes-1103793311 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:15:28 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-9b246e1c-07cc-4653-9488-4a5146a3c4e6 req-912b8a19-8328-40e1-a26d-9d12ddac66b6 tempest-TestShelveInstance-217254441 None] Deleted volume successfully. Sep 05 05:15:28 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-7f3db645-21ab-44d4-bb21-4c51343ea1c1 tempest-TestInstancesWithCinderVolumes-1103793311 None] Deleted volume successfully. Sep 05 05:15:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [req-9b246e1c-07cc-4653-9488-4a5146a3c4e6 req-912b8a19-8328-40e1-a26d-9d12ddac66b6 tempest-TestShelveInstance-217254441 None] Lock "cinder-51379d0f-a88c-4c73-a3e1-479e663acaba-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:15:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7f3db645-21ab-44d4-bb21-4c51343ea1c1 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "cinder-0955251e-dd23-4fab-9193-f8c85ff42aa6-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:15:33 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-ec2a351b-da3c-44b9-9b69-766140da079d req-edcefeab-5147-4d51-bb76-64a60ead00a0 tempest-TestInstancesWithCinderVolumes-1103793311 None] Terminate volume connection completed successfully. Sep 05 05:15:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-ec2a351b-da3c-44b9-9b69-766140da079d req-edcefeab-5147-4d51-bb76-64a60ead00a0 tempest-TestInstancesWithCinderVolumes-1103793311 None] Deleting attachment e35d70b3-3bd5-4f70-9edd-0009e61d2747. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Flow 'volume_create_manager' (a5243b32-6de0-4645-844b-f06e5f73bcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd65cc43-021b-405c-a82f-a80c34a6f6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd65cc43-021b-405c-a82f-a80c34a6f6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-386158050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef1c654d-e923-452a-b9d3-3cd61dee08e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f62167e4ece54f0a81e6bd908c6af0e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:15:34Z,use_quota=True,user_id='08b6be1678ca42dbb669f5e56c203a1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055284be-0102-4669-8a45-50959541aaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055284be-0102-4669-8a45-50959541aaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632ec4a9-52b1-4d4d-8532-91c672626e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632ec4a9-52b1-4d4d-8532-91c672626e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef1c654d-e923-452a-b9d3-3cd61dee08e9', 'volume_name': 'volume-ef1c654d-e923-452a-b9d3-3cd61dee08e9', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee96949a-ab2d-4e88-bcbb-852ccfde15b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee96949a-ab2d-4e88-bcbb-852ccfde15b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b0e7d8-04bf-4912-b81e-c39883ae0e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:34 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Volume ef1c654d-e923-452a-b9d3-3cd61dee08e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef1c654d-e923-452a-b9d3-3cd61dee08e9', 'volume_size': 1} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-386158050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef1c654d-e923-452a-b9d3-3cd61dee08e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f62167e4ece54f0a81e6bd908c6af0e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:15:34Z,use_quota=True,user_id='08b6be1678ca42dbb669f5e56c203a1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Creating volume ef1c654d-e923-452a-b9d3-3cd61dee08e9 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:15:34 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef1c654d-e923-452a-b9d3-3cd61dee08e9 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:34 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef1c654d-e923-452a-b9d3-3cd61dee08e9 1073741824 Sep 05 05:15:34 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Flow 'volume_create_manager' (36a38c89-bab3-474d-88d1-8ec66c7a4fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fdfc152-f8e1-4fff-bfe1-9bfef73c6243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fdfc152-f8e1-4fff-bfe1-9bfef73c6243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-550891527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f06b8b-2667-412d-87d7-4f86af68473a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f62167e4ece54f0a81e6bd908c6af0e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:15:35Z,use_quota=True,user_id='08b6be1678ca42dbb669f5e56c203a1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f9a9b6e-6da6-4836-bae2-99db2896319a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f9a9b6e-6da6-4836-bae2-99db2896319a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a48e02c-0ca4-4431-bd79-ac506f5fb638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a48e02c-0ca4-4431-bd79-ac506f5fb638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1f06b8b-2667-412d-87d7-4f86af68473a', 'volume_name': 'volume-a1f06b8b-2667-412d-87d7-4f86af68473a', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e4f6db-e01d-4ba9-8957-287572dae84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e4f6db-e01d-4ba9-8957-287572dae84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa643712-13fe-410c-89ca-9afcd28888b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:34 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Volume a1f06b8b-2667-412d-87d7-4f86af68473a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1f06b8b-2667-412d-87d7-4f86af68473a', 'volume_size': 1} Sep 05 05:15:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2ddfb21-c701-4cde-bc57-5c98e0988842 tempest-TestInstancesWithCinderVolumes-1103793311 None] Acquiring lock "cinder-29495694-605d-4f20-9842-bdcb27968739-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:15:35 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef1c654d-e923-452a-b9d3-3cd61dee08e9 1073741824" returned: 0 in 0.644s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2ddfb21-c701-4cde-bc57-5c98e0988842 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "cinder-29495694-605d-4f20-9842-bdcb27968739-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef1c654d-e923-452a-b9d3-3cd61dee08e9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2ddfb21-c701-4cde-bc57-5c98e0988842 tempest-TestInstancesWithCinderVolumes-1103793311 None] Acquiring lock "cinder-quobyte-29495694-605d-4f20-9842-bdcb27968739" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:15:35 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef1c654d-e923-452a-b9d3-3cd61dee08e9 Sep 05 05:15:35 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2ddfb21-c701-4cde-bc57-5c98e0988842 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "cinder-quobyte-29495694-605d-4f20-9842-bdcb27968739" acquired by "delete_volume" :: waited 0.028s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf236df-fdc0-40f4-b97c-8f3cd3b0647b]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2ddfb21-c701-4cde-bc57-5c98e0988842 tempest-TestInstancesWithCinderVolumes-1103793311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-29495694-605d-4f20-9842-bdcb27968739 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:35 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-29495694-605d-4f20-9842-bdcb27968739 Sep 05 05:15:35 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:35 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef1c654d-e923-452a-b9d3-3cd61dee08e9" returned: 0 in 0.436s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.743s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-550891527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f06b8b-2667-412d-87d7-4f86af68473a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f62167e4ece54f0a81e6bd908c6af0e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:15:35Z,use_quota=True,user_id='08b6be1678ca42dbb669f5e56c203a1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Creating volume a1f06b8b-2667-412d-87d7-4f86af68473a {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:15:35 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a1f06b8b-2667-412d-87d7-4f86af68473a 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b0e7d8-04bf-4912-b81e-c39883ae0e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef1c654d-e923-452a-b9d3-3cd61dee08e9', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:35 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a1f06b8b-2667-412d-87d7-4f86af68473a 1073741824 Sep 05 05:15:35 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1355933-60e4-4b48-983d-749ce2728832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:35 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Volume volume-ef1c654d-e923-452a-b9d3-3cd61dee08e9 (ef1c654d-e923-452a-b9d3-3cd61dee08e9): created successfully Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1355933-60e4-4b48-983d-749ce2728832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Flow 'volume_create_manager' (a5243b32-6de0-4645-844b-f06e5f73bcc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:15:35 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ffd22ac2-8483-4369-9c33-19c75bf0b812 tempest-TestServerVolumeAttachmentScenario-966176032 None] Created volume successfully. Sep 05 05:15:35 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2ddfb21-c701-4cde-bc57-5c98e0988842 tempest-TestInstancesWithCinderVolumes-1103793311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-29495694-605d-4f20-9842-bdcb27968739" returned: 0 in 0.506s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2ddfb21-c701-4cde-bc57-5c98e0988842 tempest-TestInstancesWithCinderVolumes-1103793311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-29495694-605d-4f20-9842-bdcb27968739 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:35 devstack sudo[103578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-29495694-605d-4f20-9842-bdcb27968739 Sep 05 05:15:35 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:36 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2ddfb21-c701-4cde-bc57-5c98e0988842 tempest-TestInstancesWithCinderVolumes-1103793311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-29495694-605d-4f20-9842-bdcb27968739" returned: 0 in 0.296s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2ddfb21-c701-4cde-bc57-5c98e0988842 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "cinder-quobyte-29495694-605d-4f20-9842-bdcb27968739" released by "delete_volume" :: held 0.904s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:15:36 devstack cinder-volume[89331]: WARNING cinder.quota [None req-b2ddfb21-c701-4cde-bc57-5c98e0988842 tempest-TestInstancesWithCinderVolumes-1103793311 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-368698694-1962021734 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-368698694-1962021734, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:15:36 devstack cinder-volume[89331]: WARNING cinder.quota [None req-b2ddfb21-c701-4cde-bc57-5c98e0988842 tempest-TestInstancesWithCinderVolumes-1103793311 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-368698694-1962021734 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-368698694-1962021734, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:15:36 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-b2ddfb21-c701-4cde-bc57-5c98e0988842 tempest-TestInstancesWithCinderVolumes-1103793311 None] Created reservations ['9a3508a3-5f6c-4cd0-b217-33189360b889', '62931f3b-c178-480a-b5fc-f4037c9a61b0', '8090d3c2-c1a1-4bc1-8287-29d6f7e753c2', 'c7793e6d-3dfb-4d30-8e3e-eb778aaca941'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:15:36 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a1f06b8b-2667-412d-87d7-4f86af68473a 1073741824" returned: 0 in 0.658s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a1f06b8b-2667-412d-87d7-4f86af68473a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b2ddfb21-c701-4cde-bc57-5c98e0988842 tempest-TestInstancesWithCinderVolumes-1103793311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b2ddfb21-c701-4cde-bc57-5c98e0988842 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:36 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b2ddfb21-c701-4cde-bc57-5c98e0988842 tempest-TestInstancesWithCinderVolumes-1103793311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:15:36 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b2ddfb21-c701-4cde-bc57-5c98e0988842 tempest-TestInstancesWithCinderVolumes-1103793311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:15:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b2ddfb21-c701-4cde-bc57-5c98e0988842 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2ddfb21-c701-4cde-bc57-5c98e0988842 tempest-TestInstancesWithCinderVolumes-1103793311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:36 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a1f06b8b-2667-412d-87d7-4f86af68473a Sep 05 05:15:36 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:36 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:15:36 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:36 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a1f06b8b-2667-412d-87d7-4f86af68473a" returned: 0 in 0.306s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:36 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:15:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa643712-13fe-410c-89ca-9afcd28888b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1f06b8b-2667-412d-87d7-4f86af68473a', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3658923a-fb9c-4d7f-af7f-4d576eae8600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:36 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Volume volume-a1f06b8b-2667-412d-87d7-4f86af68473a (a1f06b8b-2667-412d-87d7-4f86af68473a): created successfully Sep 05 05:15:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3658923a-fb9c-4d7f-af7f-4d576eae8600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:36 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Flow 'volume_create_manager' (36a38c89-bab3-474d-88d1-8ec66c7a4fd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:15:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2ddfb21-c701-4cde-bc57-5c98e0988842 tempest-TestInstancesWithCinderVolumes-1103793311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.341s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:36 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b2ddfb21-c701-4cde-bc57-5c98e0988842 tempest-TestInstancesWithCinderVolumes-1103793311 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:15:36 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-b2ddfb21-c701-4cde-bc57-5c98e0988842 tempest-TestInstancesWithCinderVolumes-1103793311 None] Deleted volume successfully. Sep 05 05:15:36 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-9473f40d-d495-4a8e-b829-75198795c879 tempest-TestServerVolumeAttachmentScenario-966176032 None] Created volume successfully. Sep 05 05:15:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2ddfb21-c701-4cde-bc57-5c98e0988842 tempest-TestInstancesWithCinderVolumes-1103793311 None] Lock "cinder-29495694-605d-4f20-9842-bdcb27968739-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:15:46 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=39,cinder:UPDATE=47,cinder:INSERT=10,cinder:DELETE=3 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:15:46 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=43,cinder:UPDATE=35,cinder:INSERT=8,cinder:DELETE=3 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:15:47 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:15:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Flow 'volume_create_manager' (e910cd0a-8cbb-4100-a235-5ba8680de037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:15:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d68a52e-5d45-41ee-9f1e-e5afc08f7647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d68a52e-5d45-41ee-9f1e-e5afc08f7647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1081172046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101be50e-be1c-4ede-89a5-43a4896532a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f7c498359a48058f9f4bbca564f9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:15:47Z,use_quota=True,user_id='13a1a4ced44144e38af3eafa544cae36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0878368c-f42b-4201-a1fd-b3472a4db87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0878368c-f42b-4201-a1fd-b3472a4db87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f5089f-2361-4806-a2c9-8ae069c7b7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f5089f-2361-4806-a2c9-8ae069c7b7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '101be50e-be1c-4ede-89a5-43a4896532a0', 'volume_name': 'volume-101be50e-be1c-4ede-89a5-43a4896532a0', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac831111-8df0-4e3e-9a47-e33720d00d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac831111-8df0-4e3e-9a47-e33720d00d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd48523f-02cc-4d78-9f79-25d96827f0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:47 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Volume 101be50e-be1c-4ede-89a5-43a4896532a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-101be50e-be1c-4ede-89a5-43a4896532a0', 'volume_size': 1} Sep 05 05:15:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1081172046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101be50e-be1c-4ede-89a5-43a4896532a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f7c498359a48058f9f4bbca564f9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:15:47Z,use_quota=True,user_id='13a1a4ced44144e38af3eafa544cae36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:15:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Creating volume 101be50e-be1c-4ede-89a5-43a4896532a0 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:15:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:15:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:15:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:15:47 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:15:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-101be50e-be1c-4ede-89a5-43a4896532a0 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:47 devstack sudo[103688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-101be50e-be1c-4ede-89a5-43a4896532a0 1073741824 Sep 05 05:15:47 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:48 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:15:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Flow 'volume_create_manager' (a5e03681-09d7-47da-b5f1-84d66f8aee32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:15:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc19a30-78db-4668-a768-99c45800d494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc19a30-78db-4668-a768-99c45800d494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-340906062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4447009-d4c5-4716-a645-7833ca581b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f7c498359a48058f9f4bbca564f9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:15:48Z,use_quota=True,user_id='13a1a4ced44144e38af3eafa544cae36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7066dd0-325e-4395-9724-d8392590f142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7066dd0-325e-4395-9724-d8392590f142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4b3a68-4a76-4bf8-b220-bc778e89f02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4b3a68-4a76-4bf8-b220-bc778e89f02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4447009-d4c5-4716-a645-7833ca581b84', 'volume_name': 'volume-a4447009-d4c5-4716-a645-7833ca581b84', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38bcb34-57bd-4874-b988-e9479f5d1d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38bcb34-57bd-4874-b988-e9479f5d1d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e5ed5c-c50d-47f6-b231-f285af4d6ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:48 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Volume a4447009-d4c5-4716-a645-7833ca581b84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4447009-d4c5-4716-a645-7833ca581b84', 'volume_size': 1} Sep 05 05:15:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:48 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-101be50e-be1c-4ede-89a5-43a4896532a0 1073741824" returned: 0 in 1.169s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:48 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:15:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Flow 'volume_create_manager' (4d8e04b1-8472-4dd6-ad85-802e77038b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:15:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011280bd-8f53-44bc-aca5-4d8dc8de009a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-101be50e-be1c-4ede-89a5-43a4896532a0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011280bd-8f53-44bc-aca5-4d8dc8de009a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1597263768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98c4bc0-44f0-45e3-9dbf-14e70efe6f86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f7c498359a48058f9f4bbca564f9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:15:49Z,use_quota=True,user_id='13a1a4ced44144e38af3eafa544cae36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96058d1f-cbd9-47b8-a79b-54875bd20193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96058d1f-cbd9-47b8-a79b-54875bd20193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1510556c-afa8-40a5-9979-582be53de7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:49 devstack sudo[103693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-101be50e-be1c-4ede-89a5-43a4896532a0 Sep 05 05:15:49 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1510556c-afa8-40a5-9979-582be53de7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a98c4bc0-44f0-45e3-9dbf-14e70efe6f86', 'volume_name': 'volume-a98c4bc0-44f0-45e3-9dbf-14e70efe6f86', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b1dc23-54c1-4c8c-9353-3ea39436f99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b1dc23-54c1-4c8c-9353-3ea39436f99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a474c73-5a84-4152-abee-decf727a93bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:49 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Volume a98c4bc0-44f0-45e3-9dbf-14e70efe6f86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a98c4bc0-44f0-45e3-9dbf-14e70efe6f86', 'volume_size': 1} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:49 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-101be50e-be1c-4ede-89a5-43a4896532a0" returned: 0 in 0.448s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.866s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-340906062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4447009-d4c5-4716-a645-7833ca581b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f7c498359a48058f9f4bbca564f9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:15:48Z,use_quota=True,user_id='13a1a4ced44144e38af3eafa544cae36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Creating volume a4447009-d4c5-4716-a645-7833ca581b84 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:15:49 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4447009-d4c5-4716-a645-7833ca581b84 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:49 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4447009-d4c5-4716-a645-7833ca581b84 1073741824 Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd48523f-02cc-4d78-9f79-25d96827f0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-101be50e-be1c-4ede-89a5-43a4896532a0', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:49 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf24ca0-f5e4-49a6-ab99-e43f0159aea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:49 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Volume volume-101be50e-be1c-4ede-89a5-43a4896532a0 (101be50e-be1c-4ede-89a5-43a4896532a0): created successfully Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf24ca0-f5e4-49a6-ab99-e43f0159aea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Flow 'volume_create_manager' (e910cd0a-8cbb-4100-a235-5ba8680de037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:49 devstack sudo[103698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:15:49 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:49 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-765187fa-d73f-4026-8284-be1d50fe8004 tempest-CreateVolumesFromImageTest-227929023 None] Created volume successfully. Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Flow 'volume_create_manager' (19c3f850-602c-4ec7-80c2-b18262694da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c09266-1380-4c76-850d-198db1979f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c09266-1380-4c76-850d-198db1979f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-602831858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a7d3eb8-5fe6-4372-8348-3461fa99126f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f7c498359a48058f9f4bbca564f9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:15:50Z,use_quota=True,user_id='13a1a4ced44144e38af3eafa544cae36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd64b21-18fa-4bff-93fd-6837ddeb7729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd64b21-18fa-4bff-93fd-6837ddeb7729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (610dfb9c-1204-4075-9cf5-4f46e1ef6127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (610dfb9c-1204-4075-9cf5-4f46e1ef6127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a7d3eb8-5fe6-4372-8348-3461fa99126f', 'volume_name': 'volume-3a7d3eb8-5fe6-4372-8348-3461fa99126f', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7e2421-82c0-4105-8a38-4009679bae15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7e2421-82c0-4105-8a38-4009679bae15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f251c4f-aa80-46b3-8d3a-64d5d73b8897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:49 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Volume 3a7d3eb8-5fe6-4372-8348-3461fa99126f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a7d3eb8-5fe6-4372-8348-3461fa99126f', 'volume_size': 1} Sep 05 05:15:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:50 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.326s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:50 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:15:50 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager._thread_info {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:15:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread count: 29 {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 05:15:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread info: [<_MainThread(MainThread, started 139182109970560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 05:15:50 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4447009-d4c5-4716-a645-7833ca581b84 1073741824" returned: 0 in 0.994s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4447009-d4c5-4716-a645-7833ca581b84 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:50 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:15:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Flow 'volume_create_manager' (611b697d-0368-431e-a551-6b6b0f6d9727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:15:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c161bf-e2df-4842-9594-d803b435859d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c161bf-e2df-4842-9594-d803b435859d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1256763812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30e7e53-5c94-4a05-9063-1bb74f0d0f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f7c498359a48058f9f4bbca564f9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:15:51Z,use_quota=True,user_id='13a1a4ced44144e38af3eafa544cae36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c41a49cc-1e6a-40b0-82b9-c6df560ecbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:50 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4447009-d4c5-4716-a645-7833ca581b84 Sep 05 05:15:50 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c41a49cc-1e6a-40b0-82b9-c6df560ecbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11438922-67ce-4319-b7cb-be0a4be9ca4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11438922-67ce-4319-b7cb-be0a4be9ca4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a30e7e53-5c94-4a05-9063-1bb74f0d0f3d', 'volume_name': 'volume-a30e7e53-5c94-4a05-9063-1bb74f0d0f3d', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3dc031f-8a99-45fd-81f8-18b6603112c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3dc031f-8a99-45fd-81f8-18b6603112c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0faa079-16c6-4e44-8f9c-365da297b5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:50 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Volume a30e7e53-5c94-4a05-9063-1bb74f0d0f3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a30e7e53-5c94-4a05-9063-1bb74f0d0f3d', 'volume_size': 1} Sep 05 05:15:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:51 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4447009-d4c5-4716-a645-7833ca581b84" returned: 0 in 0.486s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:15:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.053s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1597263768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98c4bc0-44f0-45e3-9dbf-14e70efe6f86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f7c498359a48058f9f4bbca564f9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:15:49Z,use_quota=True,user_id='13a1a4ced44144e38af3eafa544cae36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:15:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Creating volume a98c4bc0-44f0-45e3-9dbf-14e70efe6f86 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:15:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:15:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:15:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:15:51 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:15:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a98c4bc0-44f0-45e3-9dbf-14e70efe6f86 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e5ed5c-c50d-47f6-b231-f285af4d6ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4447009-d4c5-4716-a645-7833ca581b84', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:51 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a98c4bc0-44f0-45e3-9dbf-14e70efe6f86 1073741824 Sep 05 05:15:51 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7207c135-3edb-4fbc-960b-bd8488e67676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:51 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Volume volume-a4447009-d4c5-4716-a645-7833ca581b84 (a4447009-d4c5-4716-a645-7833ca581b84): created successfully Sep 05 05:15:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7207c135-3edb-4fbc-960b-bd8488e67676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Flow 'volume_create_manager' (a5e03681-09d7-47da-b5f1-84d66f8aee32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:15:51 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-e5e915c5-c414-4783-88d2-98b22603003b tempest-CreateVolumesFromImageTest-227929023 None] Created volume successfully. Sep 05 05:15:51 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a98c4bc0-44f0-45e3-9dbf-14e70efe6f86 1073741824" returned: 0 in 0.659s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a98c4bc0-44f0-45e3-9dbf-14e70efe6f86 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:51 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a98c4bc0-44f0-45e3-9dbf-14e70efe6f86 Sep 05 05:15:51 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:52 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a98c4bc0-44f0-45e3-9dbf-14e70efe6f86" returned: 0 in 0.321s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:15:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.287s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-602831858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a7d3eb8-5fe6-4372-8348-3461fa99126f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f7c498359a48058f9f4bbca564f9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:15:50Z,use_quota=True,user_id='13a1a4ced44144e38af3eafa544cae36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:15:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Creating volume 3a7d3eb8-5fe6-4372-8348-3461fa99126f {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:15:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:15:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:15:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:15:52 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:15:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3a7d3eb8-5fe6-4372-8348-3461fa99126f 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a474c73-5a84-4152-abee-decf727a93bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a98c4bc0-44f0-45e3-9dbf-14e70efe6f86', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:52 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3a7d3eb8-5fe6-4372-8348-3461fa99126f 1073741824 Sep 05 05:15:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e46587-b566-4755-95b4-569ebced0223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:52 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:52 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Volume volume-a98c4bc0-44f0-45e3-9dbf-14e70efe6f86 (a98c4bc0-44f0-45e3-9dbf-14e70efe6f86): created successfully Sep 05 05:15:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e46587-b566-4755-95b4-569ebced0223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:52 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Flow 'volume_create_manager' (4d8e04b1-8472-4dd6-ad85-802e77038b2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:15:52 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-e5da4fd3-8126-49ae-97f7-4156859596b8 tempest-CreateVolumesFromImageTest-227929023 None] Created volume successfully. Sep 05 05:15:52 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3a7d3eb8-5fe6-4372-8348-3461fa99126f 1073741824" returned: 0 in 0.494s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3a7d3eb8-5fe6-4372-8348-3461fa99126f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:52 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3a7d3eb8-5fe6-4372-8348-3461fa99126f Sep 05 05:15:52 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:53 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3a7d3eb8-5fe6-4372-8348-3461fa99126f" returned: 0 in 0.309s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:15:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.246s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1256763812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30e7e53-5c94-4a05-9063-1bb74f0d0f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f7c498359a48058f9f4bbca564f9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:15:51Z,use_quota=True,user_id='13a1a4ced44144e38af3eafa544cae36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:15:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Creating volume a30e7e53-5c94-4a05-9063-1bb74f0d0f3d {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:15:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:15:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:15:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:15:53 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:15:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a30e7e53-5c94-4a05-9063-1bb74f0d0f3d 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f251c4f-aa80-46b3-8d3a-64d5d73b8897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a7d3eb8-5fe6-4372-8348-3461fa99126f', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7bc3611-8996-42c5-bf9a-c68c4361e3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:53 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Volume volume-3a7d3eb8-5fe6-4372-8348-3461fa99126f (3a7d3eb8-5fe6-4372-8348-3461fa99126f): created successfully Sep 05 05:15:53 devstack sudo[103730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a30e7e53-5c94-4a05-9063-1bb74f0d0f3d 1073741824 Sep 05 05:15:53 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7bc3611-8996-42c5-bf9a-c68c4361e3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Flow 'volume_create_manager' (19c3f850-602c-4ec7-80c2-b18262694da5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:15:53 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-c7498376-a65f-4934-a269-a838a55faba3 tempest-CreateVolumesFromImageTest-227929023 None] Created volume successfully. Sep 05 05:15:53 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a30e7e53-5c94-4a05-9063-1bb74f0d0f3d 1073741824" returned: 0 in 0.530s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a30e7e53-5c94-4a05-9063-1bb74f0d0f3d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:53 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a30e7e53-5c94-4a05-9063-1bb74f0d0f3d Sep 05 05:15:53 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:53 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a30e7e53-5c94-4a05-9063-1bb74f0d0f3d" returned: 0 in 0.288s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:15:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0faa079-16c6-4e44-8f9c-365da297b5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a30e7e53-5c94-4a05-9063-1bb74f0d0f3d', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83a818e-aa12-44bd-a838-d308be5a17f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:15:54 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Volume volume-a30e7e53-5c94-4a05-9063-1bb74f0d0f3d (a30e7e53-5c94-4a05-9063-1bb74f0d0f3d): created successfully Sep 05 05:15:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83a818e-aa12-44bd-a838-d308be5a17f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:15:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Flow 'volume_create_manager' (611b697d-0368-431e-a551-6b6b0f6d9727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:15:54 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-35ba35a3-ce62-498c-b8ee-84c84a690bf1 tempest-CreateVolumesFromImageTest-227929023 None] Created volume successfully. Sep 05 05:15:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-220f2d05-a1f7-4d51-adad-1c8b03b53b00 tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "cinder-a30e7e53-5c94-4a05-9063-1bb74f0d0f3d-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:15:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-220f2d05-a1f7-4d51-adad-1c8b03b53b00 tempest-CreateVolumesFromImageTest-227929023 None] Lock "cinder-a30e7e53-5c94-4a05-9063-1bb74f0d0f3d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:15:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-220f2d05-a1f7-4d51-adad-1c8b03b53b00 tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "cinder-quobyte-a30e7e53-5c94-4a05-9063-1bb74f0d0f3d" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:15:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-220f2d05-a1f7-4d51-adad-1c8b03b53b00 tempest-CreateVolumesFromImageTest-227929023 None] Lock "cinder-quobyte-a30e7e53-5c94-4a05-9063-1bb74f0d0f3d" acquired by "delete_volume" :: waited 0.025s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:15:54 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67a921d-0fa5-409f-b5e4-9b10991c112c]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:15:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-220f2d05-a1f7-4d51-adad-1c8b03b53b00 tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a30e7e53-5c94-4a05-9063-1bb74f0d0f3d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:54 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a30e7e53-5c94-4a05-9063-1bb74f0d0f3d Sep 05 05:15:54 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:54 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-220f2d05-a1f7-4d51-adad-1c8b03b53b00 tempest-CreateVolumesFromImageTest-227929023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a30e7e53-5c94-4a05-9063-1bb74f0d0f3d" returned: 0 in 0.410s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-220f2d05-a1f7-4d51-adad-1c8b03b53b00 tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a30e7e53-5c94-4a05-9063-1bb74f0d0f3d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:54 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a30e7e53-5c94-4a05-9063-1bb74f0d0f3d Sep 05 05:15:54 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:55 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-220f2d05-a1f7-4d51-adad-1c8b03b53b00 tempest-CreateVolumesFromImageTest-227929023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a30e7e53-5c94-4a05-9063-1bb74f0d0f3d" returned: 0 in 0.294s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:55 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-220f2d05-a1f7-4d51-adad-1c8b03b53b00 tempest-CreateVolumesFromImageTest-227929023 None] Lock "cinder-quobyte-a30e7e53-5c94-4a05-9063-1bb74f0d0f3d" released by "delete_volume" :: held 0.749s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:15:55 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-220f2d05-a1f7-4d51-adad-1c8b03b53b00 tempest-CreateVolumesFromImageTest-227929023 None] Created reservations ['5830a8e4-dae4-44dd-8306-b10eba62ce36', '5613da25-2407-4a2a-9a0b-3b30f8974b3f', '0243b387-4549-43f3-acee-2fad67fb0a2b', '50c43bba-4830-4562-85e8-a7bc3f1e659b'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:15:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-220f2d05-a1f7-4d51-adad-1c8b03b53b00 tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-220f2d05-a1f7-4d51-adad-1c8b03b53b00 tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-220f2d05-a1f7-4d51-adad-1c8b03b53b00 tempest-CreateVolumesFromImageTest-227929023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:15:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-220f2d05-a1f7-4d51-adad-1c8b03b53b00 tempest-CreateVolumesFromImageTest-227929023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:15:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-220f2d05-a1f7-4d51-adad-1c8b03b53b00 tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-220f2d05-a1f7-4d51-adad-1c8b03b53b00 tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:55 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:15:55 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:55 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fee2ae49-ce89-45fe-a86f-8425ebd20714 tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "cinder-3a7d3eb8-5fe6-4372-8348-3461fa99126f-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:15:55 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fee2ae49-ce89-45fe-a86f-8425ebd20714 tempest-CreateVolumesFromImageTest-227929023 None] Lock "cinder-3a7d3eb8-5fe6-4372-8348-3461fa99126f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:15:55 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fee2ae49-ce89-45fe-a86f-8425ebd20714 tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "cinder-quobyte-3a7d3eb8-5fe6-4372-8348-3461fa99126f" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:15:55 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-220f2d05-a1f7-4d51-adad-1c8b03b53b00 tempest-CreateVolumesFromImageTest-227929023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.344s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:55 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-220f2d05-a1f7-4d51-adad-1c8b03b53b00 tempest-CreateVolumesFromImageTest-227929023 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:15:55 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fee2ae49-ce89-45fe-a86f-8425ebd20714 tempest-CreateVolumesFromImageTest-227929023 None] Lock "cinder-quobyte-3a7d3eb8-5fe6-4372-8348-3461fa99126f" acquired by "delete_volume" :: waited 0.035s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:15:55 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-220f2d05-a1f7-4d51-adad-1c8b03b53b00 tempest-CreateVolumesFromImageTest-227929023 None] Deleted volume successfully. Sep 05 05:15:55 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e9b50d-b3c0-4ce5-8a19-22de78e238d1]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:15:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fee2ae49-ce89-45fe-a86f-8425ebd20714 tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3a7d3eb8-5fe6-4372-8348-3461fa99126f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:55 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-220f2d05-a1f7-4d51-adad-1c8b03b53b00 tempest-CreateVolumesFromImageTest-227929023 None] Lock "cinder-a30e7e53-5c94-4a05-9063-1bb74f0d0f3d-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:15:56 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3a7d3eb8-5fe6-4372-8348-3461fa99126f Sep 05 05:15:56 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:56 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fee2ae49-ce89-45fe-a86f-8425ebd20714 tempest-CreateVolumesFromImageTest-227929023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3a7d3eb8-5fe6-4372-8348-3461fa99126f" returned: 0 in 0.412s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fee2ae49-ce89-45fe-a86f-8425ebd20714 tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3a7d3eb8-5fe6-4372-8348-3461fa99126f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:56 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3a7d3eb8-5fe6-4372-8348-3461fa99126f Sep 05 05:15:56 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:56 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fee2ae49-ce89-45fe-a86f-8425ebd20714 tempest-CreateVolumesFromImageTest-227929023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-3a7d3eb8-5fe6-4372-8348-3461fa99126f" returned: 0 in 0.296s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fee2ae49-ce89-45fe-a86f-8425ebd20714 tempest-CreateVolumesFromImageTest-227929023 None] Lock "cinder-quobyte-3a7d3eb8-5fe6-4372-8348-3461fa99126f" released by "delete_volume" :: held 0.777s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:15:56 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-fee2ae49-ce89-45fe-a86f-8425ebd20714 tempest-CreateVolumesFromImageTest-227929023 None] Created reservations ['673c173b-a351-45cb-a133-430b32632e94', 'b29e4406-9581-4671-8d86-46cfc2cba639', '9349414e-e5ab-421e-b0a6-27eab10f0f9f', '187a2b85-ab2a-44db-935d-509dbf345ee3'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:15:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fee2ae49-ce89-45fe-a86f-8425ebd20714 tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fee2ae49-ce89-45fe-a86f-8425ebd20714 tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-fee2ae49-ce89-45fe-a86f-8425ebd20714 tempest-CreateVolumesFromImageTest-227929023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:15:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-fee2ae49-ce89-45fe-a86f-8425ebd20714 tempest-CreateVolumesFromImageTest-227929023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:15:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fee2ae49-ce89-45fe-a86f-8425ebd20714 tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fee2ae49-ce89-45fe-a86f-8425ebd20714 tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:56 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:15:56 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9ff442c3-35be-4544-967c-bd73fb272fa3 tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "cinder-a98c4bc0-44f0-45e3-9dbf-14e70efe6f86-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:15:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9ff442c3-35be-4544-967c-bd73fb272fa3 tempest-CreateVolumesFromImageTest-227929023 None] Lock "cinder-a98c4bc0-44f0-45e3-9dbf-14e70efe6f86-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:15:57 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fee2ae49-ce89-45fe-a86f-8425ebd20714 tempest-CreateVolumesFromImageTest-227929023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.345s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:57 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-fee2ae49-ce89-45fe-a86f-8425ebd20714 tempest-CreateVolumesFromImageTest-227929023 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:15:57 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-fee2ae49-ce89-45fe-a86f-8425ebd20714 tempest-CreateVolumesFromImageTest-227929023 None] Deleted volume successfully. Sep 05 05:15:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9ff442c3-35be-4544-967c-bd73fb272fa3 tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "cinder-quobyte-a98c4bc0-44f0-45e3-9dbf-14e70efe6f86" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:15:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9ff442c3-35be-4544-967c-bd73fb272fa3 tempest-CreateVolumesFromImageTest-227929023 None] Lock "cinder-quobyte-a98c4bc0-44f0-45e3-9dbf-14e70efe6f86" acquired by "delete_volume" :: waited 0.022s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:15:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fee2ae49-ce89-45fe-a86f-8425ebd20714 tempest-CreateVolumesFromImageTest-227929023 None] Lock "cinder-3a7d3eb8-5fe6-4372-8348-3461fa99126f-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:15:57 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[748047f5-ae2a-4a73-bb07-efd96925d96c]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:15:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9ff442c3-35be-4544-967c-bd73fb272fa3 tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a98c4bc0-44f0-45e3-9dbf-14e70efe6f86 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:57 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a98c4bc0-44f0-45e3-9dbf-14e70efe6f86 Sep 05 05:15:57 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:57 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9ff442c3-35be-4544-967c-bd73fb272fa3 tempest-CreateVolumesFromImageTest-227929023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a98c4bc0-44f0-45e3-9dbf-14e70efe6f86" returned: 0 in 0.391s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9ff442c3-35be-4544-967c-bd73fb272fa3 tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a98c4bc0-44f0-45e3-9dbf-14e70efe6f86 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:57 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a98c4bc0-44f0-45e3-9dbf-14e70efe6f86 Sep 05 05:15:57 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:57 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9ff442c3-35be-4544-967c-bd73fb272fa3 tempest-CreateVolumesFromImageTest-227929023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a98c4bc0-44f0-45e3-9dbf-14e70efe6f86" returned: 0 in 0.280s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9ff442c3-35be-4544-967c-bd73fb272fa3 tempest-CreateVolumesFromImageTest-227929023 None] Lock "cinder-quobyte-a98c4bc0-44f0-45e3-9dbf-14e70efe6f86" released by "delete_volume" :: held 0.718s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:15:57 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-9ff442c3-35be-4544-967c-bd73fb272fa3 tempest-CreateVolumesFromImageTest-227929023 None] Created reservations ['43c5394d-516c-4d92-a01c-91b3d3d758c9', '45225cce-75b9-43d9-a703-d50384d7aa13', '9bb77e26-b722-49b1-b708-2de4dc16199f', '5063abe9-2cbc-4bed-910d-c0038279d9fb'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:15:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9ff442c3-35be-4544-967c-bd73fb272fa3 tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9ff442c3-35be-4544-967c-bd73fb272fa3 tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9ff442c3-35be-4544-967c-bd73fb272fa3 tempest-CreateVolumesFromImageTest-227929023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:15:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9ff442c3-35be-4544-967c-bd73fb272fa3 tempest-CreateVolumesFromImageTest-227929023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:15:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9ff442c3-35be-4544-967c-bd73fb272fa3 tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9ff442c3-35be-4544-967c-bd73fb272fa3 tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:58 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:15:58 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:58 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e6a93733-5ea8-4a2b-b947-71d5f45dbe5a tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "cinder-a4447009-d4c5-4716-a645-7833ca581b84-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:15:58 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e6a93733-5ea8-4a2b-b947-71d5f45dbe5a tempest-CreateVolumesFromImageTest-227929023 None] Lock "cinder-a4447009-d4c5-4716-a645-7833ca581b84-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:15:58 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e6a93733-5ea8-4a2b-b947-71d5f45dbe5a tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "cinder-quobyte-a4447009-d4c5-4716-a645-7833ca581b84" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:15:58 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9ff442c3-35be-4544-967c-bd73fb272fa3 tempest-CreateVolumesFromImageTest-227929023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.445s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:58 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-9ff442c3-35be-4544-967c-bd73fb272fa3 tempest-CreateVolumesFromImageTest-227929023 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:15:58 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-9ff442c3-35be-4544-967c-bd73fb272fa3 tempest-CreateVolumesFromImageTest-227929023 None] Deleted volume successfully. Sep 05 05:15:58 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e6a93733-5ea8-4a2b-b947-71d5f45dbe5a tempest-CreateVolumesFromImageTest-227929023 None] Lock "cinder-quobyte-a4447009-d4c5-4716-a645-7833ca581b84" acquired by "delete_volume" :: waited 0.038s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:15:58 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9ff442c3-35be-4544-967c-bd73fb272fa3 tempest-CreateVolumesFromImageTest-227929023 None] Lock "cinder-a98c4bc0-44f0-45e3-9dbf-14e70efe6f86-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:15:58 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad08e9e-2138-4a08-bc5c-b35294d7c82a]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:15:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e6a93733-5ea8-4a2b-b947-71d5f45dbe5a tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4447009-d4c5-4716-a645-7833ca581b84 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:58 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4447009-d4c5-4716-a645-7833ca581b84 Sep 05 05:15:58 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:58 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e6a93733-5ea8-4a2b-b947-71d5f45dbe5a tempest-CreateVolumesFromImageTest-227929023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4447009-d4c5-4716-a645-7833ca581b84" returned: 0 in 0.392s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e6a93733-5ea8-4a2b-b947-71d5f45dbe5a tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4447009-d4c5-4716-a645-7833ca581b84 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:58 devstack sudo[103821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4447009-d4c5-4716-a645-7833ca581b84 Sep 05 05:15:58 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:59 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e6a93733-5ea8-4a2b-b947-71d5f45dbe5a tempest-CreateVolumesFromImageTest-227929023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4447009-d4c5-4716-a645-7833ca581b84" returned: 0 in 0.278s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:59 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e6a93733-5ea8-4a2b-b947-71d5f45dbe5a tempest-CreateVolumesFromImageTest-227929023 None] Lock "cinder-quobyte-a4447009-d4c5-4716-a645-7833ca581b84" released by "delete_volume" :: held 0.735s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:15:59 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-e6a93733-5ea8-4a2b-b947-71d5f45dbe5a tempest-CreateVolumesFromImageTest-227929023 None] Created reservations ['0816e58a-8ab7-4f60-96b7-9c21f9f9a8a1', '8381cb07-f204-43af-9749-24ac7b97dc7f', '63dd44da-e0e1-4a3e-a6f3-e1ca43fa3306', '4fd1b87e-8f76-4099-826e-e45c32f0a837'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:15:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e6a93733-5ea8-4a2b-b947-71d5f45dbe5a tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:15:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e6a93733-5ea8-4a2b-b947-71d5f45dbe5a tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:15:59 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e6a93733-5ea8-4a2b-b947-71d5f45dbe5a tempest-CreateVolumesFromImageTest-227929023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:15:59 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e6a93733-5ea8-4a2b-b947-71d5f45dbe5a tempest-CreateVolumesFromImageTest-227929023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:15:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e6a93733-5ea8-4a2b-b947-71d5f45dbe5a tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:15:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e6a93733-5ea8-4a2b-b947-71d5f45dbe5a tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:59 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:15:59 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:15:59 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9bb2c329-876e-4c48-b7b6-8b63cd825ccc tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "cinder-101be50e-be1c-4ede-89a5-43a4896532a0-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:15:59 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9bb2c329-876e-4c48-b7b6-8b63cd825ccc tempest-CreateVolumesFromImageTest-227929023 None] Lock "cinder-101be50e-be1c-4ede-89a5-43a4896532a0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:15:59 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9bb2c329-876e-4c48-b7b6-8b63cd825ccc tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "cinder-quobyte-101be50e-be1c-4ede-89a5-43a4896532a0" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:15:59 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9bb2c329-876e-4c48-b7b6-8b63cd825ccc tempest-CreateVolumesFromImageTest-227929023 None] Lock "cinder-quobyte-101be50e-be1c-4ede-89a5-43a4896532a0" acquired by "delete_volume" :: waited 0.025s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:15:59 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Sep 05 05:15:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e6a93733-5ea8-4a2b-b947-71d5f45dbe5a tempest-CreateVolumesFromImageTest-227929023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.322s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:15:59 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-e6a93733-5ea8-4a2b-b947-71d5f45dbe5a tempest-CreateVolumesFromImageTest-227929023 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:15:59 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ce15ef-3f48-4d24-a205-b33371bb873a]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:15:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9bb2c329-876e-4c48-b7b6-8b63cd825ccc tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-101be50e-be1c-4ede-89a5-43a4896532a0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:15:59 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-e6a93733-5ea8-4a2b-b947-71d5f45dbe5a tempest-CreateVolumesFromImageTest-227929023 None] Deleted volume successfully. Sep 05 05:15:59 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e6a93733-5ea8-4a2b-b947-71d5f45dbe5a tempest-CreateVolumesFromImageTest-227929023 None] Lock "cinder-a4447009-d4c5-4716-a645-7833ca581b84-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:15:59 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-101be50e-be1c-4ede-89a5-43a4896532a0 Sep 05 05:15:59 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:00 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9bb2c329-876e-4c48-b7b6-8b63cd825ccc tempest-CreateVolumesFromImageTest-227929023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-101be50e-be1c-4ede-89a5-43a4896532a0" returned: 0 in 0.490s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9bb2c329-876e-4c48-b7b6-8b63cd825ccc tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-101be50e-be1c-4ede-89a5-43a4896532a0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:00 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-101be50e-be1c-4ede-89a5-43a4896532a0 Sep 05 05:16:00 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:00 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9bb2c329-876e-4c48-b7b6-8b63cd825ccc tempest-CreateVolumesFromImageTest-227929023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-101be50e-be1c-4ede-89a5-43a4896532a0" returned: 0 in 0.257s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:00 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9bb2c329-876e-4c48-b7b6-8b63cd825ccc tempest-CreateVolumesFromImageTest-227929023 None] Lock "cinder-quobyte-101be50e-be1c-4ede-89a5-43a4896532a0" released by "delete_volume" :: held 0.807s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:16:00 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-9bb2c329-876e-4c48-b7b6-8b63cd825ccc tempest-CreateVolumesFromImageTest-227929023 None] Created reservations ['c2e8a412-7f25-4de7-8fd5-ea5bf0cb6573', 'cbede85b-9e26-44f6-b380-ec283c592577', 'eba0b65a-95aa-4b66-b864-cb1ed18d91c9', '59e185cb-7f16-4129-bf52-936536f6226a'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:16:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9bb2c329-876e-4c48-b7b6-8b63cd825ccc tempest-CreateVolumesFromImageTest-227929023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9bb2c329-876e-4c48-b7b6-8b63cd825ccc tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:00 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9bb2c329-876e-4c48-b7b6-8b63cd825ccc tempest-CreateVolumesFromImageTest-227929023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:00 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9bb2c329-876e-4c48-b7b6-8b63cd825ccc tempest-CreateVolumesFromImageTest-227929023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9bb2c329-876e-4c48-b7b6-8b63cd825ccc tempest-CreateVolumesFromImageTest-227929023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9bb2c329-876e-4c48-b7b6-8b63cd825ccc tempest-CreateVolumesFromImageTest-227929023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:00 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:16:00 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:00 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9bb2c329-876e-4c48-b7b6-8b63cd825ccc tempest-CreateVolumesFromImageTest-227929023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.297s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:00 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-9bb2c329-876e-4c48-b7b6-8b63cd825ccc tempest-CreateVolumesFromImageTest-227929023 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:16:00 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-9bb2c329-876e-4c48-b7b6-8b63cd825ccc tempest-CreateVolumesFromImageTest-227929023 None] Deleted volume successfully. Sep 05 05:16:00 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9bb2c329-876e-4c48-b7b6-8b63cd825ccc tempest-CreateVolumesFromImageTest-227929023 None] Lock "cinder-101be50e-be1c-4ede-89a5-43a4896532a0-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:16:03 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:16:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Flow 'volume_create_manager' (7b66223e-409f-4df8-bdae-222879b04cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143e099e-eab2-4ef3-bb30-d0bf10e68026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143e099e-eab2-4ef3-bb30-d0bf10e68026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-879809727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff105416-811e-4608-a392-9bc0cf7d10ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71aac9b59ea04b1ca80c969ae6925dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:04Z,use_quota=True,user_id='06a5e26288df4f34906f5f30d16a58c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb5f7f4f-02c3-44f9-abb5-392f32cad05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb5f7f4f-02c3-44f9-abb5-392f32cad05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a9c152e-017e-43d0-9e87-779c35100c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a9c152e-017e-43d0-9e87-779c35100c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff105416-811e-4608-a392-9bc0cf7d10ca', 'volume_name': 'volume-ff105416-811e-4608-a392-9bc0cf7d10ca', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f994f657-eef9-4232-a1ea-884fb5e7bfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f994f657-eef9-4232-a1ea-884fb5e7bfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3aa4fbd-cb7e-4d73-aa1b-a7e8caf58d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:03 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Volume ff105416-811e-4608-a392-9bc0cf7d10ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff105416-811e-4608-a392-9bc0cf7d10ca', 'volume_size': 1} Sep 05 05:16:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-879809727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff105416-811e-4608-a392-9bc0cf7d10ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71aac9b59ea04b1ca80c969ae6925dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:04Z,use_quota=True,user_id='06a5e26288df4f34906f5f30d16a58c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:16:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Creating volume ff105416-811e-4608-a392-9bc0cf7d10ca {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:16:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:16:03 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:16:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff105416-811e-4608-a392-9bc0cf7d10ca 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:03 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff105416-811e-4608-a392-9bc0cf7d10ca 1073741824 Sep 05 05:16:03 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:04 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff105416-811e-4608-a392-9bc0cf7d10ca 1073741824" returned: 0 in 0.448s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff105416-811e-4608-a392-9bc0cf7d10ca {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:04 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff105416-811e-4608-a392-9bc0cf7d10ca Sep 05 05:16:04 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:04 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff105416-811e-4608-a392-9bc0cf7d10ca" returned: 0 in 0.255s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:16:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3aa4fbd-cb7e-4d73-aa1b-a7e8caf58d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff105416-811e-4608-a392-9bc0cf7d10ca', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72f44163-46ff-43eb-95a7-1be790f01b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:04 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Volume volume-ff105416-811e-4608-a392-9bc0cf7d10ca (ff105416-811e-4608-a392-9bc0cf7d10ca): created successfully Sep 05 05:16:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72f44163-46ff-43eb-95a7-1be790f01b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Flow 'volume_create_manager' (7b66223e-409f-4df8-bdae-222879b04cfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:04 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-22e639c0-3530-4ba5-9c2e-d8c18b93919c tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Created volume successfully. Sep 05 05:16:05 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:16:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Flow 'volume_create_manager' (6d9ac82c-d33d-4c7c-8be4-9bc948f4cd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede500c8-6ccb-495f-ae1e-2f3bfd2c22b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede500c8-6ccb-495f-ae1e-2f3bfd2c22b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1147101493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a8b877-c719-443c-ac95-d52e3922d4f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71aac9b59ea04b1ca80c969ae6925dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:05Z,use_quota=True,user_id='06a5e26288df4f34906f5f30d16a58c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f2c166-89c3-4bd9-b8b1-b5e9af3cced2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f2c166-89c3-4bd9-b8b1-b5e9af3cced2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3c4a9f-3481-45f6-82a5-f0f592aa305a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3c4a9f-3481-45f6-82a5-f0f592aa305a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36a8b877-c719-443c-ac95-d52e3922d4f0', 'volume_name': 'volume-36a8b877-c719-443c-ac95-d52e3922d4f0', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7e8092-615c-4c09-a3ea-959f1498f4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7e8092-615c-4c09-a3ea-959f1498f4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a4f1e9-d78c-4a30-b615-192834cbfdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:05 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Volume 36a8b877-c719-443c-ac95-d52e3922d4f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36a8b877-c719-443c-ac95-d52e3922d4f0', 'volume_size': 1} Sep 05 05:16:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1147101493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a8b877-c719-443c-ac95-d52e3922d4f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71aac9b59ea04b1ca80c969ae6925dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:05Z,use_quota=True,user_id='06a5e26288df4f34906f5f30d16a58c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:16:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Creating volume 36a8b877-c719-443c-ac95-d52e3922d4f0 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:16:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:16:05 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:16:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36a8b877-c719-443c-ac95-d52e3922d4f0 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:05 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36a8b877-c719-443c-ac95-d52e3922d4f0 1073741824 Sep 05 05:16:05 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:05 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Flow 'volume_create_manager' (daa3fca4-f0b5-4f42-a067-69b6db764372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:06 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15fd554-351c-40eb-85f7-df584d6a41e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36a8b877-c719-443c-ac95-d52e3922d4f0 1073741824" returned: 0 in 0.712s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15fd554-351c-40eb-85f7-df584d6a41e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-414188056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c24651-d03d-464d-8c68-0bdf209544f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71aac9b59ea04b1ca80c969ae6925dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:06Z,use_quota=True,user_id='06a5e26288df4f34906f5f30d16a58c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5d6b20-9ecd-424c-b245-76c1abd42edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5d6b20-9ecd-424c-b245-76c1abd42edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e58cd1f-2875-4af3-9f15-b5dce4039d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e58cd1f-2875-4af3-9f15-b5dce4039d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94c24651-d03d-464d-8c68-0bdf209544f6', 'volume_name': 'volume-94c24651-d03d-464d-8c68-0bdf209544f6', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7674c968-cbad-49dd-ace9-a7e41b540ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7674c968-cbad-49dd-ace9-a7e41b540ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0a3890-ac3d-4404-8b5c-67ecfbe75ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:06 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Volume 94c24651-d03d-464d-8c68-0bdf209544f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94c24651-d03d-464d-8c68-0bdf209544f6', 'volume_size': 1} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36a8b877-c719-443c-ac95-d52e3922d4f0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:06 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36a8b877-c719-443c-ac95-d52e3922d4f0 Sep 05 05:16:06 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Flow 'volume_create_manager' (7f4e5ac0-8113-4dfc-a693-2d30dc8f8a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095f9890-1dbd-4e20-b94d-da098419c5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095f9890-1dbd-4e20-b94d-da098419c5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1138924703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b1982b-ba09-486c-9172-966e701bb4f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71aac9b59ea04b1ca80c969ae6925dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:06Z,use_quota=True,user_id='06a5e26288df4f34906f5f30d16a58c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d38da0a-5a25-45c5-9553-3a14f1cd7e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d38da0a-5a25-45c5-9553-3a14f1cd7e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9375e471-cc99-4bf6-b919-dd2d91b6d304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9375e471-cc99-4bf6-b919-dd2d91b6d304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10b1982b-ba09-486c-9172-966e701bb4f8', 'volume_name': 'volume-10b1982b-ba09-486c-9172-966e701bb4f8', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5e00ac-3c18-441c-a884-6deaec567696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5e00ac-3c18-441c-a884-6deaec567696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56be1acb-0681-48cd-b111-ff1770bd85d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:06 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Volume 10b1982b-ba09-486c-9172-966e701bb4f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10b1982b-ba09-486c-9172-966e701bb4f8', 'volume_size': 1} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:06 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36a8b877-c719-443c-ac95-d52e3922d4f0" returned: 0 in 0.359s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.404s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-414188056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c24651-d03d-464d-8c68-0bdf209544f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71aac9b59ea04b1ca80c969ae6925dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:06Z,use_quota=True,user_id='06a5e26288df4f34906f5f30d16a58c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Creating volume 94c24651-d03d-464d-8c68-0bdf209544f6 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:16:06 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-94c24651-d03d-464d-8c68-0bdf209544f6 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a4f1e9-d78c-4a30-b615-192834cbfdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36a8b877-c719-443c-ac95-d52e3922d4f0', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa72f40-8f15-4708-8bf5-700ebae1e891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:06 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-94c24651-d03d-464d-8c68-0bdf209544f6 1073741824 Sep 05 05:16:06 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:06 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Volume volume-36a8b877-c719-443c-ac95-d52e3922d4f0 (36a8b877-c719-443c-ac95-d52e3922d4f0): created successfully Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa72f40-8f15-4708-8bf5-700ebae1e891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Flow 'volume_create_manager' (6d9ac82c-d33d-4c7c-8be4-9bc948f4cd02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:06 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-00997bb7-3b3f-4ecd-a1c9-7d6675572c98 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Created volume successfully. Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Flow 'volume_create_manager' (be78300e-bb0d-4689-a29c-778a277e4c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e14f23e-415a-4c92-aeac-3de79fc20c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e14f23e-415a-4c92-aeac-3de79fc20c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2082114214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50acbd3d-1148-44f2-93f2-2078fec41509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71aac9b59ea04b1ca80c969ae6925dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:07Z,use_quota=True,user_id='06a5e26288df4f34906f5f30d16a58c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (defed8d7-3ac0-4961-87f9-60b6e06102b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (defed8d7-3ac0-4961-87f9-60b6e06102b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a19202-9dd6-43bb-bc22-1510d152084f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a19202-9dd6-43bb-bc22-1510d152084f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50acbd3d-1148-44f2-93f2-2078fec41509', 'volume_name': 'volume-50acbd3d-1148-44f2-93f2-2078fec41509', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a06a447-f6b4-4186-aaf9-7702ce92db55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a06a447-f6b4-4186-aaf9-7702ce92db55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ef560f-71fd-45dd-8b74-5e1ab1abf3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:06 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Volume 50acbd3d-1148-44f2-93f2-2078fec41509: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50acbd3d-1148-44f2-93f2-2078fec41509', 'volume_size': 1} Sep 05 05:16:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Flow 'volume_create_manager' (41a0d360-abe1-43db-a760-42f7abe5a2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25adabd7-6b4e-499e-b577-a8045df0bb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:07 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-94c24651-d03d-464d-8c68-0bdf209544f6 1073741824" returned: 0 in 0.598s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25adabd7-6b4e-499e-b577-a8045df0bb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1849981742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075ad25f-ea2f-4951-b6fa-471cada8a271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71aac9b59ea04b1ca80c969ae6925dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:07Z,use_quota=True,user_id='06a5e26288df4f34906f5f30d16a58c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc35a14-6c1c-4e24-8831-895428f48d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc35a14-6c1c-4e24-8831-895428f48d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f96736-3d68-4b88-b59d-236013adb75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f96736-3d68-4b88-b59d-236013adb75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '075ad25f-ea2f-4951-b6fa-471cada8a271', 'volume_name': 'volume-075ad25f-ea2f-4951-b6fa-471cada8a271', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a124933a-1e12-4548-9585-e2edb4412ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a124933a-1e12-4548-9585-e2edb4412ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31582027-0a53-4ef0-95e0-deea7aa7dcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:07 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Volume 075ad25f-ea2f-4951-b6fa-471cada8a271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-075ad25f-ea2f-4951-b6fa-471cada8a271', 'volume_size': 1} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-94c24651-d03d-464d-8c68-0bdf209544f6 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:07 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-94c24651-d03d-464d-8c68-0bdf209544f6 Sep 05 05:16:07 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:07 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-94c24651-d03d-464d-8c68-0bdf209544f6" returned: 0 in 0.297s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.207s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1138924703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b1982b-ba09-486c-9172-966e701bb4f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71aac9b59ea04b1ca80c969ae6925dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:06Z,use_quota=True,user_id='06a5e26288df4f34906f5f30d16a58c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Creating volume 10b1982b-ba09-486c-9172-966e701bb4f8 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:16:07 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-10b1982b-ba09-486c-9172-966e701bb4f8 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:07 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-10b1982b-ba09-486c-9172-966e701bb4f8 1073741824 Sep 05 05:16:07 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0a3890-ac3d-4404-8b5c-67ecfbe75ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94c24651-d03d-464d-8c68-0bdf209544f6', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686a41f7-43f0-4eba-837c-850f8ffda486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:07 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Volume volume-94c24651-d03d-464d-8c68-0bdf209544f6 (94c24651-d03d-464d-8c68-0bdf209544f6): created successfully Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686a41f7-43f0-4eba-837c-850f8ffda486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Flow 'volume_create_manager' (daa3fca4-f0b5-4f42-a067-69b6db764372) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:07 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-3d9747cf-8507-4ab9-9244-744fa46e53b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Created volume successfully. Sep 05 05:16:08 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-10b1982b-ba09-486c-9172-966e701bb4f8 1073741824" returned: 0 in 0.587s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-10b1982b-ba09-486c-9172-966e701bb4f8 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:08 devstack sudo[103888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-10b1982b-ba09-486c-9172-966e701bb4f8 Sep 05 05:16:08 devstack sudo[103888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:08 devstack sudo[103888]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-10b1982b-ba09-486c-9172-966e701bb4f8" returned: 0 in 0.270s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:16:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.624s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2082114214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50acbd3d-1148-44f2-93f2-2078fec41509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71aac9b59ea04b1ca80c969ae6925dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:07Z,use_quota=True,user_id='06a5e26288df4f34906f5f30d16a58c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:16:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Creating volume 50acbd3d-1148-44f2-93f2-2078fec41509 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:16:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:16:08 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:16:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-50acbd3d-1148-44f2-93f2-2078fec41509 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56be1acb-0681-48cd-b111-ff1770bd85d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10b1982b-ba09-486c-9172-966e701bb4f8', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e4c6443-c3ee-4866-b34d-1210a24ed60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:08 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-50acbd3d-1148-44f2-93f2-2078fec41509 1073741824 Sep 05 05:16:08 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:08 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Volume volume-10b1982b-ba09-486c-9172-966e701bb4f8 (10b1982b-ba09-486c-9172-966e701bb4f8): created successfully Sep 05 05:16:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e4c6443-c3ee-4866-b34d-1210a24ed60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Flow 'volume_create_manager' (7f4e5ac0-8113-4dfc-a693-2d30dc8f8a42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:08 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-f4bbd621-e531-4dd1-b15e-d1f2da943637 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Created volume successfully. Sep 05 05:16:09 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-50acbd3d-1148-44f2-93f2-2078fec41509 1073741824" returned: 0 in 0.600s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-50acbd3d-1148-44f2-93f2-2078fec41509 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:09 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-50acbd3d-1148-44f2-93f2-2078fec41509 Sep 05 05:16:09 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:09 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-50acbd3d-1148-44f2-93f2-2078fec41509" returned: 0 in 0.296s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:16:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.204s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1849981742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075ad25f-ea2f-4951-b6fa-471cada8a271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71aac9b59ea04b1ca80c969ae6925dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:07Z,use_quota=True,user_id='06a5e26288df4f34906f5f30d16a58c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:16:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Creating volume 075ad25f-ea2f-4951-b6fa-471cada8a271 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:16:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:16:09 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:16:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-075ad25f-ea2f-4951-b6fa-471cada8a271 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ef560f-71fd-45dd-8b74-5e1ab1abf3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50acbd3d-1148-44f2-93f2-2078fec41509', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af6b195-208d-41b0-9554-77a25f28ec3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:09 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-075ad25f-ea2f-4951-b6fa-471cada8a271 1073741824 Sep 05 05:16:09 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:09 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Volume volume-50acbd3d-1148-44f2-93f2-2078fec41509 (50acbd3d-1148-44f2-93f2-2078fec41509): created successfully Sep 05 05:16:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af6b195-208d-41b0-9554-77a25f28ec3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Flow 'volume_create_manager' (be78300e-bb0d-4689-a29c-778a277e4c92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:09 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-2681d349-16f7-4639-ac1c-ab08aa7ef9b1 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Created volume successfully. Sep 05 05:16:09 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-075ad25f-ea2f-4951-b6fa-471cada8a271 1073741824" returned: 0 in 0.484s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-075ad25f-ea2f-4951-b6fa-471cada8a271 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:09 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-075ad25f-ea2f-4951-b6fa-471cada8a271 Sep 05 05:16:09 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:10 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-075ad25f-ea2f-4951-b6fa-471cada8a271" returned: 0 in 0.261s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:16:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31582027-0a53-4ef0-95e0-deea7aa7dcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-075ad25f-ea2f-4951-b6fa-471cada8a271', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b3638d-48de-4283-bae6-c8d5ae9d0705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:10 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Volume volume-075ad25f-ea2f-4951-b6fa-471cada8a271 (075ad25f-ea2f-4951-b6fa-471cada8a271): created successfully Sep 05 05:16:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b3638d-48de-4283-bae6-c8d5ae9d0705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Flow 'volume_create_manager' (41a0d360-abe1-43db-a760-42f7abe5a2c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:10 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-81b13478-23bf-49a6-bdf2-304b590b960b tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Created volume successfully. Sep 05 05:16:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7104403e-6e1c-4a9e-9db0-7d6a3b47249e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "cinder-075ad25f-ea2f-4951-b6fa-471cada8a271-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:16:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7104403e-6e1c-4a9e-9db0-7d6a3b47249e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-075ad25f-ea2f-4951-b6fa-471cada8a271-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:16:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7104403e-6e1c-4a9e-9db0-7d6a3b47249e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "cinder-quobyte-075ad25f-ea2f-4951-b6fa-471cada8a271" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:16:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7104403e-6e1c-4a9e-9db0-7d6a3b47249e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-quobyte-075ad25f-ea2f-4951-b6fa-471cada8a271" acquired by "delete_volume" :: waited 0.014s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:16:10 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5be926-e5a2-46b2-b3b7-99d933f0275d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:16:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7104403e-6e1c-4a9e-9db0-7d6a3b47249e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-075ad25f-ea2f-4951-b6fa-471cada8a271 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:10 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-075ad25f-ea2f-4951-b6fa-471cada8a271 Sep 05 05:16:10 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:11 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7104403e-6e1c-4a9e-9db0-7d6a3b47249e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-075ad25f-ea2f-4951-b6fa-471cada8a271" returned: 0 in 0.416s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7104403e-6e1c-4a9e-9db0-7d6a3b47249e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-075ad25f-ea2f-4951-b6fa-471cada8a271 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:11 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-075ad25f-ea2f-4951-b6fa-471cada8a271 Sep 05 05:16:11 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:11 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7104403e-6e1c-4a9e-9db0-7d6a3b47249e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-075ad25f-ea2f-4951-b6fa-471cada8a271" returned: 0 in 0.248s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7104403e-6e1c-4a9e-9db0-7d6a3b47249e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-quobyte-075ad25f-ea2f-4951-b6fa-471cada8a271" released by "delete_volume" :: held 0.711s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:16:11 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-7104403e-6e1c-4a9e-9db0-7d6a3b47249e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Created reservations ['9a0f89cc-0f97-4fb8-9684-5487208ddd75', '5a64ff23-9192-4200-bf5f-66dd69455151', 'aa38128e-f21b-4989-bf09-1e97dde2fed4', '01aff0a5-d9c0-41aa-9fb9-5e36b0a50868'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:16:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7104403e-6e1c-4a9e-9db0-7d6a3b47249e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7104403e-6e1c-4a9e-9db0-7d6a3b47249e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7104403e-6e1c-4a9e-9db0-7d6a3b47249e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7104403e-6e1c-4a9e-9db0-7d6a3b47249e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7104403e-6e1c-4a9e-9db0-7d6a3b47249e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7104403e-6e1c-4a9e-9db0-7d6a3b47249e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:11 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:16:11 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b9eb0c8f-be34-41e9-80ea-cb8fd6338789 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "cinder-50acbd3d-1148-44f2-93f2-2078fec41509-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:16:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b9eb0c8f-be34-41e9-80ea-cb8fd6338789 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-50acbd3d-1148-44f2-93f2-2078fec41509-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:16:11 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7104403e-6e1c-4a9e-9db0-7d6a3b47249e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.266s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:11 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-7104403e-6e1c-4a9e-9db0-7d6a3b47249e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:16:11 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-7104403e-6e1c-4a9e-9db0-7d6a3b47249e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Deleted volume successfully. Sep 05 05:16:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7104403e-6e1c-4a9e-9db0-7d6a3b47249e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-075ad25f-ea2f-4951-b6fa-471cada8a271-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:16:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b9eb0c8f-be34-41e9-80ea-cb8fd6338789 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "cinder-quobyte-50acbd3d-1148-44f2-93f2-2078fec41509" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:16:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b9eb0c8f-be34-41e9-80ea-cb8fd6338789 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-quobyte-50acbd3d-1148-44f2-93f2-2078fec41509" acquired by "delete_volume" :: waited 0.019s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:16:11 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8320d20f-131a-453b-8ab2-07d3da2f5385]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:16:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b9eb0c8f-be34-41e9-80ea-cb8fd6338789 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-50acbd3d-1148-44f2-93f2-2078fec41509 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:11 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-50acbd3d-1148-44f2-93f2-2078fec41509 Sep 05 05:16:11 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:12 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b9eb0c8f-be34-41e9-80ea-cb8fd6338789 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-50acbd3d-1148-44f2-93f2-2078fec41509" returned: 0 in 0.534s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b9eb0c8f-be34-41e9-80ea-cb8fd6338789 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-50acbd3d-1148-44f2-93f2-2078fec41509 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:12 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-50acbd3d-1148-44f2-93f2-2078fec41509 Sep 05 05:16:12 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:12 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b9eb0c8f-be34-41e9-80ea-cb8fd6338789 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-50acbd3d-1148-44f2-93f2-2078fec41509" returned: 0 in 0.346s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b9eb0c8f-be34-41e9-80ea-cb8fd6338789 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-quobyte-50acbd3d-1148-44f2-93f2-2078fec41509" released by "delete_volume" :: held 0.930s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:16:12 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-b9eb0c8f-be34-41e9-80ea-cb8fd6338789 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Created reservations ['507b303f-69ea-4ffb-929e-df225b78ae74', '49189541-6857-4603-b33c-4a06d65ec0d6', '5e2c6df4-f3cf-4a83-8708-d1c510ad228e', '8bb28ca8-72c0-4835-80f8-1ab5d3c63e5d'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:16:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b9eb0c8f-be34-41e9-80ea-cb8fd6338789 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b9eb0c8f-be34-41e9-80ea-cb8fd6338789 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b9eb0c8f-be34-41e9-80ea-cb8fd6338789 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b9eb0c8f-be34-41e9-80ea-cb8fd6338789 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b9eb0c8f-be34-41e9-80ea-cb8fd6338789 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b9eb0c8f-be34-41e9-80ea-cb8fd6338789 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:12 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:16:12 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-0753cf72-33d2-41c6-8fd2-0a47c93c4b66 req-3f128de5-013f-4ea2-8f9d-a558fa92de3b tempest-TestServerVolumeAttachmentScenario-966176032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-0753cf72-33d2-41c6-8fd2-0a47c93c4b66 req-3f128de5-013f-4ea2-8f9d-a558fa92de3b tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-0753cf72-33d2-41c6-8fd2-0a47c93c4b66 req-3f128de5-013f-4ea2-8f9d-a558fa92de3b tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:13 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-0753cf72-33d2-41c6-8fd2-0a47c93c4b66 req-3f128de5-013f-4ea2-8f9d-a558fa92de3b tempest-TestServerVolumeAttachmentScenario-966176032 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136', 'name': 'volume-ef1c654d-e923-452a-b9d3-3cd61dee08e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a86647a3-29e1-472a-93f8-91e191f93e91', 'enforce_multipath': True} {{(pid=89331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 05:16:13 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b9eb0c8f-be34-41e9-80ea-cb8fd6338789 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.305s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:13 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b9eb0c8f-be34-41e9-80ea-cb8fd6338789 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:16:13 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-b9eb0c8f-be34-41e9-80ea-cb8fd6338789 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Deleted volume successfully. Sep 05 05:16:13 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b9eb0c8f-be34-41e9-80ea-cb8fd6338789 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-50acbd3d-1148-44f2-93f2-2078fec41509-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:16:13 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-0753cf72-33d2-41c6-8fd2-0a47c93c4b66 req-3f128de5-013f-4ea2-8f9d-a558fa92de3b tempest-TestServerVolumeAttachmentScenario-966176032 None] attachment_update completed successfully. Sep 05 05:16:14 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-df35e6d7-30ff-428b-897c-c99bd66271ac tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "cinder-10b1982b-ba09-486c-9172-966e701bb4f8-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:16:14 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-df35e6d7-30ff-428b-897c-c99bd66271ac tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-10b1982b-ba09-486c-9172-966e701bb4f8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:16:14 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-df35e6d7-30ff-428b-897c-c99bd66271ac tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "cinder-quobyte-10b1982b-ba09-486c-9172-966e701bb4f8" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:16:14 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-df35e6d7-30ff-428b-897c-c99bd66271ac tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-quobyte-10b1982b-ba09-486c-9172-966e701bb4f8" acquired by "delete_volume" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:16:14 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[89db06bd-5674-457a-9d43-7962700ecd62]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:16:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-df35e6d7-30ff-428b-897c-c99bd66271ac tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-10b1982b-ba09-486c-9172-966e701bb4f8 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:14 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-10b1982b-ba09-486c-9172-966e701bb4f8 Sep 05 05:16:14 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:14 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-df35e6d7-30ff-428b-897c-c99bd66271ac tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-10b1982b-ba09-486c-9172-966e701bb4f8" returned: 0 in 0.384s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-df35e6d7-30ff-428b-897c-c99bd66271ac tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-10b1982b-ba09-486c-9172-966e701bb4f8 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:14 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-10b1982b-ba09-486c-9172-966e701bb4f8 Sep 05 05:16:14 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:14 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-df35e6d7-30ff-428b-897c-c99bd66271ac tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-10b1982b-ba09-486c-9172-966e701bb4f8" returned: 0 in 0.280s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:14 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-df35e6d7-30ff-428b-897c-c99bd66271ac tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-quobyte-10b1982b-ba09-486c-9172-966e701bb4f8" released by "delete_volume" :: held 0.710s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:16:14 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-df35e6d7-30ff-428b-897c-c99bd66271ac tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Created reservations ['2619b4b0-4516-4594-9963-9ed310cdd191', '405ce946-def1-483a-afbc-6e9a873e87c2', '52b2dc4f-0461-45a8-8272-1011d60ad9a5', 'c5636d81-72e2-461c-99e3-db174cb2df57'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:16:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-df35e6d7-30ff-428b-897c-c99bd66271ac tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-df35e6d7-30ff-428b-897c-c99bd66271ac tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:14 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-df35e6d7-30ff-428b-897c-c99bd66271ac tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:14 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-df35e6d7-30ff-428b-897c-c99bd66271ac tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-df35e6d7-30ff-428b-897c-c99bd66271ac tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-df35e6d7-30ff-428b-897c-c99bd66271ac tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:15 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:16:15 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:15 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-df35e6d7-30ff-428b-897c-c99bd66271ac tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.277s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:15 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-df35e6d7-30ff-428b-897c-c99bd66271ac tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:16:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-752f7c2f-5443-426c-8c34-ebafccc85c33 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "cinder-94c24651-d03d-464d-8c68-0bdf209544f6-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:16:15 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-df35e6d7-30ff-428b-897c-c99bd66271ac tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Deleted volume successfully. Sep 05 05:16:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-752f7c2f-5443-426c-8c34-ebafccc85c33 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-94c24651-d03d-464d-8c68-0bdf209544f6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:16:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-df35e6d7-30ff-428b-897c-c99bd66271ac tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-10b1982b-ba09-486c-9172-966e701bb4f8-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:16:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-752f7c2f-5443-426c-8c34-ebafccc85c33 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "cinder-quobyte-94c24651-d03d-464d-8c68-0bdf209544f6" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:16:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-752f7c2f-5443-426c-8c34-ebafccc85c33 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-quobyte-94c24651-d03d-464d-8c68-0bdf209544f6" acquired by "delete_volume" :: waited 0.027s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:16:15 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31bc2f8-b906-4cd8-9e16-be32352cb93c]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:16:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-752f7c2f-5443-426c-8c34-ebafccc85c33 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-94c24651-d03d-464d-8c68-0bdf209544f6 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:15 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-94c24651-d03d-464d-8c68-0bdf209544f6 Sep 05 05:16:15 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:15 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-752f7c2f-5443-426c-8c34-ebafccc85c33 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-94c24651-d03d-464d-8c68-0bdf209544f6" returned: 0 in 0.461s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-752f7c2f-5443-426c-8c34-ebafccc85c33 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-94c24651-d03d-464d-8c68-0bdf209544f6 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:15 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-94c24651-d03d-464d-8c68-0bdf209544f6 Sep 05 05:16:15 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:16 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-752f7c2f-5443-426c-8c34-ebafccc85c33 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-94c24651-d03d-464d-8c68-0bdf209544f6" returned: 0 in 0.273s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-752f7c2f-5443-426c-8c34-ebafccc85c33 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-quobyte-94c24651-d03d-464d-8c68-0bdf209544f6" released by "delete_volume" :: held 0.795s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:16:16 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-752f7c2f-5443-426c-8c34-ebafccc85c33 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Created reservations ['27aa6776-9579-42c7-85eb-608cfabbfaa0', 'cf97d7f2-5a20-4a90-a87c-e5ac44534415', '6b544293-5380-41cd-968e-5ed03522e688', 'c57d277b-f96c-4930-8b25-32dc0e6650c3'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:16:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-752f7c2f-5443-426c-8c34-ebafccc85c33 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-752f7c2f-5443-426c-8c34-ebafccc85c33 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:16 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-752f7c2f-5443-426c-8c34-ebafccc85c33 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:16 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-752f7c2f-5443-426c-8c34-ebafccc85c33 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-752f7c2f-5443-426c-8c34-ebafccc85c33 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-752f7c2f-5443-426c-8c34-ebafccc85c33 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:16 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:16:16 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c44d7416-ae6b-42c3-afca-54801372a171 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "cinder-36a8b877-c719-443c-ac95-d52e3922d4f0-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:16:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c44d7416-ae6b-42c3-afca-54801372a171 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-36a8b877-c719-443c-ac95-d52e3922d4f0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:16:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c44d7416-ae6b-42c3-afca-54801372a171 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "cinder-quobyte-36a8b877-c719-443c-ac95-d52e3922d4f0" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:16:16 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-752f7c2f-5443-426c-8c34-ebafccc85c33 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.332s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:16 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-752f7c2f-5443-426c-8c34-ebafccc85c33 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:16:16 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-752f7c2f-5443-426c-8c34-ebafccc85c33 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Deleted volume successfully. Sep 05 05:16:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c44d7416-ae6b-42c3-afca-54801372a171 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-quobyte-36a8b877-c719-443c-ac95-d52e3922d4f0" acquired by "delete_volume" :: waited 0.037s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:16:16 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98134ae-c41f-4955-987d-b9cf114c09db]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:16:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c44d7416-ae6b-42c3-afca-54801372a171 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36a8b877-c719-443c-ac95-d52e3922d4f0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-752f7c2f-5443-426c-8c34-ebafccc85c33 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-94c24651-d03d-464d-8c68-0bdf209544f6-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:16:16 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36a8b877-c719-443c-ac95-d52e3922d4f0 Sep 05 05:16:16 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:17 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c44d7416-ae6b-42c3-afca-54801372a171 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36a8b877-c719-443c-ac95-d52e3922d4f0" returned: 0 in 0.447s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c44d7416-ae6b-42c3-afca-54801372a171 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36a8b877-c719-443c-ac95-d52e3922d4f0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:17 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36a8b877-c719-443c-ac95-d52e3922d4f0 Sep 05 05:16:17 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:17 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c44d7416-ae6b-42c3-afca-54801372a171 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36a8b877-c719-443c-ac95-d52e3922d4f0" returned: 0 in 0.328s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:17 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c44d7416-ae6b-42c3-afca-54801372a171 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-quobyte-36a8b877-c719-443c-ac95-d52e3922d4f0" released by "delete_volume" :: held 0.831s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:16:17 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-c44d7416-ae6b-42c3-afca-54801372a171 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Created reservations ['df646886-ce5a-43df-bbfd-a38858505cff', '027bcf22-033b-4dff-9236-d7b94a36c24e', '1ca98558-823c-4e19-91d8-2b26f0069696', '8e72b773-68a6-4a65-a9ca-93c56b73866f'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:16:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c44d7416-ae6b-42c3-afca-54801372a171 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c44d7416-ae6b-42c3-afca-54801372a171 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c44d7416-ae6b-42c3-afca-54801372a171 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c44d7416-ae6b-42c3-afca-54801372a171 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c44d7416-ae6b-42c3-afca-54801372a171 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c44d7416-ae6b-42c3-afca-54801372a171 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:17 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:16:17 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:17 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-791fcb57-4c58-492f-9293-a70223dc1e2e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "cinder-ff105416-811e-4608-a392-9bc0cf7d10ca-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:16:17 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-791fcb57-4c58-492f-9293-a70223dc1e2e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-ff105416-811e-4608-a392-9bc0cf7d10ca-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:16:17 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-791fcb57-4c58-492f-9293-a70223dc1e2e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "cinder-quobyte-ff105416-811e-4608-a392-9bc0cf7d10ca" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:16:17 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-791fcb57-4c58-492f-9293-a70223dc1e2e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-quobyte-ff105416-811e-4608-a392-9bc0cf7d10ca" acquired by "delete_volume" :: waited 0.025s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:16:17 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca298b6-d512-441e-84e1-a8724ffe239c]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:16:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-791fcb57-4c58-492f-9293-a70223dc1e2e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff105416-811e-4608-a392-9bc0cf7d10ca {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:18 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c44d7416-ae6b-42c3-afca-54801372a171 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.366s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:18 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-c44d7416-ae6b-42c3-afca-54801372a171 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:16:18 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-c44d7416-ae6b-42c3-afca-54801372a171 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Deleted volume successfully. Sep 05 05:16:18 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff105416-811e-4608-a392-9bc0cf7d10ca Sep 05 05:16:18 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c44d7416-ae6b-42c3-afca-54801372a171 tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-36a8b877-c719-443c-ac95-d52e3922d4f0-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:16:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-0157bd17-07b2-4c65-99a3-e05ad4d29f73 req-dd16967f-07ea-4775-8986-5d1b702e7c55 tempest-TestServerVolumeAttachmentScenario-966176032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-0157bd17-07b2-4c65-99a3-e05ad4d29f73 req-dd16967f-07ea-4775-8986-5d1b702e7c55 tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-0157bd17-07b2-4c65-99a3-e05ad4d29f73 req-dd16967f-07ea-4775-8986-5d1b702e7c55 tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:18 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-0157bd17-07b2-4c65-99a3-e05ad4d29f73 req-dd16967f-07ea-4775-8986-5d1b702e7c55 tempest-TestServerVolumeAttachmentScenario-966176032 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136', 'name': 'volume-a1f06b8b-2667-412d-87d7-4f86af68473a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '198188a8-3094-4b60-9dbe-dfd951ce5107', 'enforce_multipath': True} {{(pid=89331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 05:16:18 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-791fcb57-4c58-492f-9293-a70223dc1e2e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff105416-811e-4608-a392-9bc0cf7d10ca" returned: 0 in 0.437s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-791fcb57-4c58-492f-9293-a70223dc1e2e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff105416-811e-4608-a392-9bc0cf7d10ca {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:18 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff105416-811e-4608-a392-9bc0cf7d10ca Sep 05 05:16:18 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:18 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-0157bd17-07b2-4c65-99a3-e05ad4d29f73 req-dd16967f-07ea-4775-8986-5d1b702e7c55 tempest-TestServerVolumeAttachmentScenario-966176032 None] attachment_update completed successfully. Sep 05 05:16:18 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-791fcb57-4c58-492f-9293-a70223dc1e2e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff105416-811e-4608-a392-9bc0cf7d10ca" returned: 0 in 0.278s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-791fcb57-4c58-492f-9293-a70223dc1e2e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-quobyte-ff105416-811e-4608-a392-9bc0cf7d10ca" released by "delete_volume" :: held 0.800s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:16:18 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-791fcb57-4c58-492f-9293-a70223dc1e2e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Created reservations ['dc5d95b9-95bf-43cf-a158-675bbd137b80', '9441d601-e17c-4430-b82e-f172664fbca2', 'deff5da7-8cf2-411a-8a3b-5dfe147186cd', 'a2320ff1-78c7-4a82-aeaf-de2f0bf36e4f'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:16:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-791fcb57-4c58-492f-9293-a70223dc1e2e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-791fcb57-4c58-492f-9293-a70223dc1e2e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:18 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-791fcb57-4c58-492f-9293-a70223dc1e2e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:18 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-791fcb57-4c58-492f-9293-a70223dc1e2e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-791fcb57-4c58-492f-9293-a70223dc1e2e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-791fcb57-4c58-492f-9293-a70223dc1e2e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:18 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:16:18 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:19 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-791fcb57-4c58-492f-9293-a70223dc1e2e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.336s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:19 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-791fcb57-4c58-492f-9293-a70223dc1e2e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:16:19 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-791fcb57-4c58-492f-9293-a70223dc1e2e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Deleted volume successfully. Sep 05 05:16:19 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-791fcb57-4c58-492f-9293-a70223dc1e2e tempest-CreateVolumesFromSourceVolumeTest-1783779112 None] Lock "cinder-ff105416-811e-4608-a392-9bc0cf7d10ca-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:16:20 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:16:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Flow 'volume_create_manager' (cc6e25e4-e011-46ee-893b-a596d5c1a36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649551cf-7f40-4263-846d-5e57813b4e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649551cf-7f40-4263-846d-5e57813b4e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-777398019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7ad299-4ae7-49a3-9bb5-c6e29681fc61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5762dac458d7447899d1fd1e845f2767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:20Z,use_quota=True,user_id='9d36b5f2d65b474f87f752d69345c4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b956f12-6a2c-4996-a094-f488ef284fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b956f12-6a2c-4996-a094-f488ef284fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba9becdf-3dc1-4ed1-8b6c-e60b35f1aaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba9becdf-3dc1-4ed1-8b6c-e60b35f1aaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e7ad299-4ae7-49a3-9bb5-c6e29681fc61', 'volume_name': 'volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348504cb-562b-4f47-9a1a-6c9dcccd7f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348504cb-562b-4f47-9a1a-6c9dcccd7f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c47084e-0596-4914-8d8f-6c6a9be49b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:20 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Volume 4e7ad299-4ae7-49a3-9bb5-c6e29681fc61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61', 'volume_size': 1} Sep 05 05:16:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-777398019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7ad299-4ae7-49a3-9bb5-c6e29681fc61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5762dac458d7447899d1fd1e845f2767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:20Z,use_quota=True,user_id='9d36b5f2d65b474f87f752d69345c4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:16:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Creating volume 4e7ad299-4ae7-49a3-9bb5-c6e29681fc61 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:16:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:16:20 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:16:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:20 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61 1073741824 Sep 05 05:16:20 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:21 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61 1073741824" returned: 0 in 0.518s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:21 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61 Sep 05 05:16:21 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:21 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-ec038a9c-25a8-49bf-a865-7f69d48a71a9 req-da1de85c-c093-43fe-b65d-9ec15bfebba6 tempest-TestServerVolumeAttachmentScenario-966176032 None] Terminate volume connection completed successfully. Sep 05 05:16:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-ec038a9c-25a8-49bf-a865-7f69d48a71a9 req-da1de85c-c093-43fe-b65d-9ec15bfebba6 tempest-TestServerVolumeAttachmentScenario-966176032 None] Deleting attachment 198188a8-3094-4b60-9dbe-dfd951ce5107. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:16:21 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61" returned: 0 in 0.300s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:16:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c47084e-0596-4914-8d8f-6c6a9be49b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb912c6-3e31-46b5-9a32-8a23ad01cac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:21 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Volume volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61 (4e7ad299-4ae7-49a3-9bb5-c6e29681fc61): created successfully Sep 05 05:16:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb912c6-3e31-46b5-9a32-8a23ad01cac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Flow 'volume_create_manager' (cc6e25e4-e011-46ee-893b-a596d5c1a36d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:21 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-4782b161-c1dc-4ab5-bf55-f344d467d054 tempest-TestImageHashVerification-541353892 None] Created volume successfully. Sep 05 05:16:22 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-98181ed0-4f4d-4fa7-8392-99859eff15ea req-d27073c9-b16c-49fa-bf09-1f54633d3948 tempest-TestServerVolumeAttachmentScenario-966176032 None] Terminate volume connection completed successfully. Sep 05 05:16:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-98181ed0-4f4d-4fa7-8392-99859eff15ea req-d27073c9-b16c-49fa-bf09-1f54633d3948 tempest-TestServerVolumeAttachmentScenario-966176032 None] Deleting attachment a86647a3-29e1-472a-93f8-91e191f93e91. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:16:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fdbb10c4-bd36-4e5e-a985-b41a852558d1 tempest-TestImageHashVerification-541353892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fdbb10c4-bd36-4e5e-a985-b41a852558d1 tempest-TestImageHashVerification-541353892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:23 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ed604c-e61a-4ab2-b817-fce4aba8ec27]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:16:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fdbb10c4-bd36-4e5e-a985-b41a852558d1 tempest-TestImageHashVerification-541353892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:23 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61 Sep 05 05:16:23 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:23 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fdbb10c4-bd36-4e5e-a985-b41a852558d1 tempest-TestImageHashVerification-541353892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61" returned: 0 in 0.425s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:23 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[60113f8c-31be-4376-af59-581335c3e7f1]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:16:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fdbb10c4-bd36-4e5e-a985-b41a852558d1 tempest-TestImageHashVerification-541353892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:24 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61 Sep 05 05:16:24 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:24 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fdbb10c4-bd36-4e5e-a985-b41a852558d1 tempest-TestImageHashVerification-541353892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61" returned: 0 in 0.666s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fdbb10c4-bd36-4e5e-a985-b41a852558d1 tempest-TestImageHashVerification-541353892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61 /opt/stack/data/cinder/conversion/4e7ad299-4ae7-49a3-9bb5-c6e29681fc61.temp_image.8e643f81-918d-44ca-9bda-f564fe6d8f1db68gg0g2.img {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:24 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61 /opt/stack/data/cinder/conversion/4e7ad299-4ae7-49a3-9bb5-c6e29681fc61.temp_image.8e643f81-918d-44ca-9bda-f564fe6d8f1db68gg0g2.img Sep 05 05:16:24 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:29 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fdbb10c4-bd36-4e5e-a985-b41a852558d1 tempest-TestImageHashVerification-541353892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61 /opt/stack/data/cinder/conversion/4e7ad299-4ae7-49a3-9bb5-c6e29681fc61.temp_image.8e643f81-918d-44ca-9bda-f564fe6d8f1db68gg0g2.img" returned: 0 in 5.255s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:29 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[11693951-4b75-4d8e-a3c3-dcb2708f21d4]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:16:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fdbb10c4-bd36-4e5e-a985-b41a852558d1 tempest-TestImageHashVerification-541353892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:29 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61 Sep 05 05:16:29 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2bd9a6d-5276-47fd-b94f-6e50d4226aab tempest-TestServerVolumeAttachmentScenario-966176032 None] Acquiring lock "cinder-a1f06b8b-2667-412d-87d7-4f86af68473a-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:16:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2bd9a6d-5276-47fd-b94f-6e50d4226aab tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "cinder-a1f06b8b-2667-412d-87d7-4f86af68473a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:16:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2bd9a6d-5276-47fd-b94f-6e50d4226aab tempest-TestServerVolumeAttachmentScenario-966176032 None] Acquiring lock "cinder-quobyte-a1f06b8b-2667-412d-87d7-4f86af68473a" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:16:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2bd9a6d-5276-47fd-b94f-6e50d4226aab tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "cinder-quobyte-a1f06b8b-2667-412d-87d7-4f86af68473a" acquired by "delete_volume" :: waited 0.017s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:16:30 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ba290c-bbb5-4840-a0d2-960e1337570e]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:16:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2bd9a6d-5276-47fd-b94f-6e50d4226aab tempest-TestServerVolumeAttachmentScenario-966176032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a1f06b8b-2667-412d-87d7-4f86af68473a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:30 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fdbb10c4-bd36-4e5e-a985-b41a852558d1 tempest-TestImageHashVerification-541353892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61" returned: 0 in 0.549s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:30 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-fdbb10c4-bd36-4e5e-a985-b41a852558d1 tempest-TestImageHashVerification-541353892 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61, size 1024.00 MB, duration 5.26 sec, destination /opt/stack/data/cinder/conversion/4e7ad299-4ae7-49a3-9bb5-c6e29681fc61.temp_image.8e643f81-918d-44ca-9bda-f564fe6d8f1db68gg0g2.img {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:16:30 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-fdbb10c4-bd36-4e5e-a985-b41a852558d1 tempest-TestImageHashVerification-541353892 None] Converted 1024.00 MB image at 194.80 MB/s Sep 05 05:16:30 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-fdbb10c4-bd36-4e5e-a985-b41a852558d1 tempest-TestImageHashVerification-541353892 None] 8e643f81-918d-44ca-9bda-f564fe6d8f1d was raw, no need to convert to raw {{(pid=89331) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 05 05:16:30 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a1f06b8b-2667-412d-87d7-4f86af68473a Sep 05 05:16:30 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:30 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2bd9a6d-5276-47fd-b94f-6e50d4226aab tempest-TestServerVolumeAttachmentScenario-966176032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a1f06b8b-2667-412d-87d7-4f86af68473a" returned: 0 in 0.369s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2bd9a6d-5276-47fd-b94f-6e50d4226aab tempest-TestServerVolumeAttachmentScenario-966176032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a1f06b8b-2667-412d-87d7-4f86af68473a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:30 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a1f06b8b-2667-412d-87d7-4f86af68473a Sep 05 05:16:30 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:30 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2bd9a6d-5276-47fd-b94f-6e50d4226aab tempest-TestServerVolumeAttachmentScenario-966176032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a1f06b8b-2667-412d-87d7-4f86af68473a" returned: 0 in 0.255s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2bd9a6d-5276-47fd-b94f-6e50d4226aab tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "cinder-quobyte-a1f06b8b-2667-412d-87d7-4f86af68473a" released by "delete_volume" :: held 0.672s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:16:31 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-b2bd9a6d-5276-47fd-b94f-6e50d4226aab tempest-TestServerVolumeAttachmentScenario-966176032 None] Created reservations ['73ee6eb8-4712-4574-ac85-9b0e5965db49', '03519adb-bd76-4ff6-8088-077a6afdf49b', 'b52fa457-4a9e-4b4b-bf0f-fa6ba5e215a3', '04d8b77b-68f5-4e37-a892-3a47e5c99712'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:16:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b2bd9a6d-5276-47fd-b94f-6e50d4226aab tempest-TestServerVolumeAttachmentScenario-966176032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b2bd9a6d-5276-47fd-b94f-6e50d4226aab tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b2bd9a6d-5276-47fd-b94f-6e50d4226aab tempest-TestServerVolumeAttachmentScenario-966176032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b2bd9a6d-5276-47fd-b94f-6e50d4226aab tempest-TestServerVolumeAttachmentScenario-966176032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b2bd9a6d-5276-47fd-b94f-6e50d4226aab tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2bd9a6d-5276-47fd-b94f-6e50d4226aab tempest-TestServerVolumeAttachmentScenario-966176032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:31 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:16:31 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:31 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2bd9a6d-5276-47fd-b94f-6e50d4226aab tempest-TestServerVolumeAttachmentScenario-966176032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.252s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:31 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b2bd9a6d-5276-47fd-b94f-6e50d4226aab tempest-TestServerVolumeAttachmentScenario-966176032 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:16:31 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-b2bd9a6d-5276-47fd-b94f-6e50d4226aab tempest-TestServerVolumeAttachmentScenario-966176032 None] Deleted volume successfully. Sep 05 05:16:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2bd9a6d-5276-47fd-b94f-6e50d4226aab tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "cinder-a1f06b8b-2667-412d-87d7-4f86af68473a-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:16:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-aa1f32c1-cbf6-497e-9de5-2894b4d822c8 tempest-TestServerVolumeAttachmentScenario-966176032 None] Acquiring lock "cinder-ef1c654d-e923-452a-b9d3-3cd61dee08e9-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:16:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-aa1f32c1-cbf6-497e-9de5-2894b4d822c8 tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "cinder-ef1c654d-e923-452a-b9d3-3cd61dee08e9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:16:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-aa1f32c1-cbf6-497e-9de5-2894b4d822c8 tempest-TestServerVolumeAttachmentScenario-966176032 None] Acquiring lock "cinder-quobyte-ef1c654d-e923-452a-b9d3-3cd61dee08e9" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:16:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-aa1f32c1-cbf6-497e-9de5-2894b4d822c8 tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "cinder-quobyte-ef1c654d-e923-452a-b9d3-3cd61dee08e9" acquired by "delete_volume" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:16:31 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c066326-60f4-4891-9aa7-f001fe72fc70]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:16:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa1f32c1-cbf6-497e-9de5-2894b4d822c8 tempest-TestServerVolumeAttachmentScenario-966176032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef1c654d-e923-452a-b9d3-3cd61dee08e9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:31 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef1c654d-e923-452a-b9d3-3cd61dee08e9 Sep 05 05:16:31 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:31 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa1f32c1-cbf6-497e-9de5-2894b4d822c8 tempest-TestServerVolumeAttachmentScenario-966176032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef1c654d-e923-452a-b9d3-3cd61dee08e9" returned: 0 in 0.355s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa1f32c1-cbf6-497e-9de5-2894b4d822c8 tempest-TestServerVolumeAttachmentScenario-966176032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef1c654d-e923-452a-b9d3-3cd61dee08e9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:31 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef1c654d-e923-452a-b9d3-3cd61dee08e9 Sep 05 05:16:31 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:32 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa1f32c1-cbf6-497e-9de5-2894b4d822c8 tempest-TestServerVolumeAttachmentScenario-966176032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef1c654d-e923-452a-b9d3-3cd61dee08e9" returned: 0 in 0.265s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:32 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-aa1f32c1-cbf6-497e-9de5-2894b4d822c8 tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "cinder-quobyte-ef1c654d-e923-452a-b9d3-3cd61dee08e9" released by "delete_volume" :: held 0.655s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:16:32 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-aa1f32c1-cbf6-497e-9de5-2894b4d822c8 tempest-TestServerVolumeAttachmentScenario-966176032 None] Created reservations ['80d2d651-7f06-42dc-b3c4-ed6e06dd0954', '3bd79d12-5cac-46a2-a5e0-a3aaead1b24d', 'aa52e96e-f5b3-49b4-8599-00fe87486487', '263b466f-4233-46e3-8338-3f30fd04df49'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:16:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-aa1f32c1-cbf6-497e-9de5-2894b4d822c8 tempest-TestServerVolumeAttachmentScenario-966176032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-aa1f32c1-cbf6-497e-9de5-2894b4d822c8 tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:32 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-aa1f32c1-cbf6-497e-9de5-2894b4d822c8 tempest-TestServerVolumeAttachmentScenario-966176032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:32 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-aa1f32c1-cbf6-497e-9de5-2894b4d822c8 tempest-TestServerVolumeAttachmentScenario-966176032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-aa1f32c1-cbf6-497e-9de5-2894b4d822c8 tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa1f32c1-cbf6-497e-9de5-2894b4d822c8 tempest-TestServerVolumeAttachmentScenario-966176032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:32 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:16:32 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:32 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aa1f32c1-cbf6-497e-9de5-2894b4d822c8 tempest-TestServerVolumeAttachmentScenario-966176032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.278s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:32 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-aa1f32c1-cbf6-497e-9de5-2894b4d822c8 tempest-TestServerVolumeAttachmentScenario-966176032 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:16:32 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-aa1f32c1-cbf6-497e-9de5-2894b4d822c8 tempest-TestServerVolumeAttachmentScenario-966176032 None] Deleted volume successfully. Sep 05 05:16:32 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-aa1f32c1-cbf6-497e-9de5-2894b4d822c8 tempest-TestServerVolumeAttachmentScenario-966176032 None] Lock "cinder-ef1c654d-e923-452a-b9d3-3cd61dee08e9-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:16:42 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=103,cinder:UPDATE=149,cinder:INSERT=30,cinder:DELETE=11 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:16:42 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:UPDATE=138,cinder:SELECT=109,cinder:DELETE=14,cinder:INSERT=34 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:16:46 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:16:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Flow 'volume_create_manager' (dc0efaea-1ccc-48bf-9d53-f9c4704411bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4301883-31a0-4ddb-a7a9-e023dc4b7360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4301883-31a0-4ddb-a7a9-e023dc4b7360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-832915087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807449b0-b4b8-49fb-bc01-8bde35ee98e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9456dc574f499eb5ef07e5611ae614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:46Z,use_quota=True,user_id='4ffcfee0d91642fd83d614829e463de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5fc4328-358d-4f44-9a93-1747a300737b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5fc4328-358d-4f44-9a93-1747a300737b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae303d5e-5d79-4873-b5d5-6cf5c44e43be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae303d5e-5d79-4873-b5d5-6cf5c44e43be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '807449b0-b4b8-49fb-bc01-8bde35ee98e2', 'volume_name': 'volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ebd9f8-0a92-42d8-8a5f-b0431ed7fac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ebd9f8-0a92-42d8-8a5f-b0431ed7fac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8affe999-a26d-4852-be44-e3e1b75a38fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:46 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Volume 807449b0-b4b8-49fb-bc01-8bde35ee98e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2', 'volume_size': 1} Sep 05 05:16:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:16:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:49 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:16:49 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:49 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.256s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:49 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:16:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager._thread_info {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:16:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread count: 29 {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 05:16:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread info: [<_MainThread(MainThread, started 139182109970560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 05:16:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fdbb10c4-bd36-4e5e-a985-b41a852558d1 tempest-TestImageHashVerification-541353892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.118s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fdbb10c4-bd36-4e5e-a985-b41a852558d1 tempest-TestImageHashVerification-541353892 None] Uploaded volume to glance image-id: 8e643f81-918d-44ca-9bda-f564fe6d8f1d. {{(pid=89331) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 05 05:16:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.356s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-832915087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807449b0-b4b8-49fb-bc01-8bde35ee98e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9456dc574f499eb5ef07e5611ae614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:46Z,use_quota=True,user_id='4ffcfee0d91642fd83d614829e463de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:16:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Creating volume 807449b0-b4b8-49fb-bc01-8bde35ee98e2 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:16:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:16:50 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:16:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:50 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2 1073741824 Sep 05 05:16:50 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:50 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-fdbb10c4-bd36-4e5e-a985-b41a852558d1 tempest-TestImageHashVerification-541353892 None] Copy volume to image completed successfully. Sep 05 05:16:51 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2 1073741824" returned: 0 in 0.399s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:51 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2 Sep 05 05:16:51 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:51 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2" returned: 0 in 0.248s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:16:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8affe999-a26d-4852-be44-e3e1b75a38fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (517a0016-4597-4ed0-a837-937c1913bc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:51 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Volume volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2 (807449b0-b4b8-49fb-bc01-8bde35ee98e2): created successfully Sep 05 05:16:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (517a0016-4597-4ed0-a837-937c1913bc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Flow 'volume_create_manager' (dc0efaea-1ccc-48bf-9d53-f9c4704411bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:51 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-2bc5241e-e962-45d9-9869-2ca938f4d251 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Created volume successfully. Sep 05 05:16:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-89185162-871a-4248-9291-da797c37fa8b tempest-TestImageHashVerification-541353892 None] Acquiring lock "cinder-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:16:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-89185162-871a-4248-9291-da797c37fa8b tempest-TestImageHashVerification-541353892 None] Lock "cinder-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:16:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-89185162-871a-4248-9291-da797c37fa8b tempest-TestImageHashVerification-541353892 None] Acquiring lock "cinder-quobyte-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:16:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-89185162-871a-4248-9291-da797c37fa8b tempest-TestImageHashVerification-541353892 None] Lock "cinder-quobyte-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61" acquired by "delete_volume" :: waited 0.015s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:16:52 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4c1458-423f-438d-9ada-f64f3c83da92]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:16:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-89185162-871a-4248-9291-da797c37fa8b tempest-TestImageHashVerification-541353892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:52 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61 Sep 05 05:16:52 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9f78109d-5296-4c80-82ac-8944b33de421 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9f78109d-5296-4c80-82ac-8944b33de421 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:52 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-9f78109d-5296-4c80-82ac-8944b33de421 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Creating offline snapshot fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708 of volume 807449b0-b4b8-49fb-bc01-8bde35ee98e2 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:16:52 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f7af80-b50c-4c99-984b-77a79ae39b42]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:16:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9f78109d-5296-4c80-82ac-8944b33de421 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:52 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-89185162-871a-4248-9291-da797c37fa8b tempest-TestImageHashVerification-541353892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61" returned: 0 in 0.383s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-89185162-871a-4248-9291-da797c37fa8b tempest-TestImageHashVerification-541353892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:52 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61 Sep 05 05:16:52 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:52 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2 Sep 05 05:16:52 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:52 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-89185162-871a-4248-9291-da797c37fa8b tempest-TestImageHashVerification-541353892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61" returned: 0 in 0.236s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-89185162-871a-4248-9291-da797c37fa8b tempest-TestImageHashVerification-541353892 None] Lock "cinder-quobyte-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61" released by "delete_volume" :: held 0.656s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:16:52 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-89185162-871a-4248-9291-da797c37fa8b tempest-TestImageHashVerification-541353892 None] Created reservations ['e689b9fc-31c2-4ffe-9183-64987a52e381', '337304eb-8ab5-47e6-af90-5eaac436099c', '51966c1f-dc40-46a3-a831-1a815c915863', '847cf2c0-5cbe-4e00-a842-65e8f341cc6d'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:16:52 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9f78109d-5296-4c80-82ac-8944b33de421 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2" returned: 0 in 0.378s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9f78109d-5296-4c80-82ac-8944b33de421 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:53 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708 1G Sep 05 05:16:53 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-89185162-871a-4248-9291-da797c37fa8b tempest-TestImageHashVerification-541353892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-89185162-871a-4248-9291-da797c37fa8b tempest-TestImageHashVerification-541353892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-89185162-871a-4248-9291-da797c37fa8b tempest-TestImageHashVerification-541353892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-89185162-871a-4248-9291-da797c37fa8b tempest-TestImageHashVerification-541353892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-89185162-871a-4248-9291-da797c37fa8b tempest-TestImageHashVerification-541353892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-89185162-871a-4248-9291-da797c37fa8b tempest-TestImageHashVerification-541353892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:53 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:16:53 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:53 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-89185162-871a-4248-9291-da797c37fa8b tempest-TestImageHashVerification-541353892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.259s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:53 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-89185162-871a-4248-9291-da797c37fa8b tempest-TestImageHashVerification-541353892 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:16:53 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-89185162-871a-4248-9291-da797c37fa8b tempest-TestImageHashVerification-541353892 None] Deleted volume successfully. Sep 05 05:16:53 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-89185162-871a-4248-9291-da797c37fa8b tempest-TestImageHashVerification-541353892 None] Lock "cinder-4e7ad299-4ae7-49a3-9bb5-c6e29681fc61-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:16:53 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9f78109d-5296-4c80-82ac-8944b33de421 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708 1G" returned: 0 in 0.442s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9f78109d-5296-4c80-82ac-8944b33de421 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:53 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708 Sep 05 05:16:53 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:53 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9f78109d-5296-4c80-82ac-8944b33de421 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708" returned: 0 in 0.299s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:53 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-9f78109d-5296-4c80-82ac-8944b33de421 tempest-CreateVolumesFromSnapshotTest-1097533248 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708 is being set with open permissions: ugo+rw Sep 05 05:16:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9f78109d-5296-4c80-82ac-8944b33de421 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:53 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708 Sep 05 05:16:53 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:53 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9f78109d-5296-4c80-82ac-8944b33de421 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708" returned: 0 in 0.248s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9f78109d-5296-4c80-82ac-8944b33de421 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:54 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.info Sep 05 05:16:54 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:54 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9f78109d-5296-4c80-82ac-8944b33de421 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.info" returned: 0 in 0.250s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:54 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-9f78109d-5296-4c80-82ac-8944b33de421 tempest-CreateVolumesFromSnapshotTest-1097533248 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.info is being set with open permissions: ugo+rw Sep 05 05:16:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9f78109d-5296-4c80-82ac-8944b33de421 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:54 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.info Sep 05 05:16:54 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:54 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9f78109d-5296-4c80-82ac-8944b33de421 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.info" returned: 0 in 0.250s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9f78109d-5296-4c80-82ac-8944b33de421 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.970s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:54 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-9f78109d-5296-4c80-82ac-8944b33de421 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Create snapshot completed successfully Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Flow 'volume_create_manager' (be8e6284-3e3d-4fc5-a56d-2e3112ac5c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045b5f34-322a-426c-b5f3-2250f092e814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045b5f34-322a-426c-b5f3-2250f092e814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-461609883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67163e4-c8a4-4c9c-9691-1038fd32411c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9456dc574f499eb5ef07e5611ae614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:55Z,use_quota=True,user_id='4ffcfee0d91642fd83d614829e463de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182be994-68c1-4541-b980-38b5b5079116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182be994-68c1-4541-b980-38b5b5079116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6081f4c-211f-49b4-a12a-d313143ae1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6081f4c-211f-49b4-a12a-d313143ae1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c67163e4-c8a4-4c9c-9691-1038fd32411c', 'volume_name': 'volume-c67163e4-c8a4-4c9c-9691-1038fd32411c', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c936d319-d5dc-4917-b42e-6a3a0a1a5ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c936d319-d5dc-4917-b42e-6a3a0a1a5ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90437ca0-34df-4a00-a6ce-23955b4d47e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:55 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Volume c67163e4-c8a4-4c9c-9691-1038fd32411c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c67163e4-c8a4-4c9c-9691-1038fd32411c', 'volume_size': 1} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-461609883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67163e4-c8a4-4c9c-9691-1038fd32411c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9456dc574f499eb5ef07e5611ae614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:55Z,use_quota=True,user_id='4ffcfee0d91642fd83d614829e463de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Creating volume c67163e4-c8a4-4c9c-9691-1038fd32411c {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:16:55 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c67163e4-c8a4-4c9c-9691-1038fd32411c 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:55 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c67163e4-c8a4-4c9c-9691-1038fd32411c 1073741824 Sep 05 05:16:55 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Flow 'volume_create_manager' (c24ad5a7-4c49-42c4-be60-8d74aee07670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1705f85f-86b8-4703-ba83-02707db19f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1705f85f-86b8-4703-ba83-02707db19f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1131579197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a403a10c-fb85-4a63-8bc5-937972339f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9456dc574f499eb5ef07e5611ae614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:56Z,use_quota=True,user_id='4ffcfee0d91642fd83d614829e463de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cff0f5f-ada1-4644-9a10-70679a3313b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cff0f5f-ada1-4644-9a10-70679a3313b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af4b110-a672-4384-b02b-198af0ffcba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af4b110-a672-4384-b02b-198af0ffcba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a403a10c-fb85-4a63-8bc5-937972339f1e', 'volume_name': 'volume-a403a10c-fb85-4a63-8bc5-937972339f1e', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daaa562b-fc83-4d73-80d1-afe0e036bae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daaa562b-fc83-4d73-80d1-afe0e036bae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b5aef9-083c-43f9-83b2-6604cc0797e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:55 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Volume a403a10c-fb85-4a63-8bc5-937972339f1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a403a10c-fb85-4a63-8bc5-937972339f1e', 'volume_size': 1} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:55 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c67163e4-c8a4-4c9c-9691-1038fd32411c 1073741824" returned: 0 in 0.589s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c67163e4-c8a4-4c9c-9691-1038fd32411c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:55 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c67163e4-c8a4-4c9c-9691-1038fd32411c Sep 05 05:16:55 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Flow 'volume_create_manager' (9d3f3800-9ff1-418a-8c68-6525930a44cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af23b9fb-a919-43f7-9622-c306b5fb2e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af23b9fb-a919-43f7-9622-c306b5fb2e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1890427526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f212305a-0329-4315-9ed6-7a93d8cd9ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9456dc574f499eb5ef07e5611ae614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:56Z,use_quota=True,user_id='4ffcfee0d91642fd83d614829e463de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7baf8f96-4b95-47a9-8675-f0d996555f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7baf8f96-4b95-47a9-8675-f0d996555f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1045b0-9971-4340-9eb2-14c223bf018a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1045b0-9971-4340-9eb2-14c223bf018a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f212305a-0329-4315-9ed6-7a93d8cd9ae9', 'volume_name': 'volume-f212305a-0329-4315-9ed6-7a93d8cd9ae9', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27fe4842-dd70-4fec-a8a7-6cfdef3a1673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27fe4842-dd70-4fec-a8a7-6cfdef3a1673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d98aecb-9122-496d-b137-1b312552e0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:56 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Volume f212305a-0329-4315-9ed6-7a93d8cd9ae9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f212305a-0329-4315-9ed6-7a93d8cd9ae9', 'volume_size': 1} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:56 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c67163e4-c8a4-4c9c-9691-1038fd32411c" returned: 0 in 0.320s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.555s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1131579197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a403a10c-fb85-4a63-8bc5-937972339f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9456dc574f499eb5ef07e5611ae614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:56Z,use_quota=True,user_id='4ffcfee0d91642fd83d614829e463de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Creating volume a403a10c-fb85-4a63-8bc5-937972339f1e {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:16:56 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a403a10c-fb85-4a63-8bc5-937972339f1e 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:56 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a403a10c-fb85-4a63-8bc5-937972339f1e 1073741824 Sep 05 05:16:56 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90437ca0-34df-4a00-a6ce-23955b4d47e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c67163e4-c8a4-4c9c-9691-1038fd32411c', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd47ef15-0707-4e5a-bd35-569d23693e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:56 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Volume volume-c67163e4-c8a4-4c9c-9691-1038fd32411c (c67163e4-c8a4-4c9c-9691-1038fd32411c): created successfully Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd47ef15-0707-4e5a-bd35-569d23693e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Flow 'volume_create_manager' (be8e6284-3e3d-4fc5-a56d-2e3112ac5c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:56 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-8519f2fe-2e21-46a4-a60c-00f0bca88d03 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Created volume successfully. Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Flow 'volume_create_manager' (35706b14-ab99-43b5-b9b6-ed0cc65f2580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dfc74c6-0c03-4357-b754-8f805d9ec021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dfc74c6-0c03-4357-b754-8f805d9ec021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1193765451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8924ecb9-a7fd-412e-8b82-560a4e8305ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9456dc574f499eb5ef07e5611ae614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:56Z,use_quota=True,user_id='4ffcfee0d91642fd83d614829e463de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569cbda8-0293-44d7-b9c0-aaea7e6f17e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569cbda8-0293-44d7-b9c0-aaea7e6f17e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e4af57-c50e-4c73-8188-d2fdfab0a186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e4af57-c50e-4c73-8188-d2fdfab0a186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8924ecb9-a7fd-412e-8b82-560a4e8305ef', 'volume_name': 'volume-8924ecb9-a7fd-412e-8b82-560a4e8305ef', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e009d62-d3cf-492e-b725-72982941538b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e009d62-d3cf-492e-b725-72982941538b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14f9ca96-cc20-45bc-8a9a-8bea6ecf400f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:56 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Volume 8924ecb9-a7fd-412e-8b82-560a4e8305ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8924ecb9-a7fd-412e-8b82-560a4e8305ef', 'volume_size': 1} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:56 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a403a10c-fb85-4a63-8bc5-937972339f1e 1073741824" returned: 0 in 0.575s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a403a10c-fb85-4a63-8bc5-937972339f1e {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:56 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a403a10c-fb85-4a63-8bc5-937972339f1e Sep 05 05:16:56 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Flow 'volume_create_manager' (a2584b32-0bd0-4876-9e92-a0fd8bce77c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c421afd0-cdd2-4d20-8b20-dc66ffe91faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c421afd0-cdd2-4d20-8b20-dc66ffe91faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1999640865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef912fbf-da1c-4f18-bb7b-f2d14b401dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9456dc574f499eb5ef07e5611ae614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:57Z,use_quota=True,user_id='4ffcfee0d91642fd83d614829e463de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e08705-1170-4457-86ac-4ed38ef4c65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e08705-1170-4457-86ac-4ed38ef4c65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d0814d-9416-40d0-bd4a-84f08e523178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d0814d-9416-40d0-bd4a-84f08e523178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef912fbf-da1c-4f18-bb7b-f2d14b401dfe', 'volume_name': 'volume-ef912fbf-da1c-4f18-bb7b-f2d14b401dfe', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf74e41f-9360-42a2-8a00-0939b0464501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf74e41f-9360-42a2-8a00-0939b0464501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b7090e-242b-49a4-adec-3f8c88f94a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:57 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Volume ef912fbf-da1c-4f18-bb7b-f2d14b401dfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef912fbf-da1c-4f18-bb7b-f2d14b401dfe', 'volume_size': 1} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:57 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a403a10c-fb85-4a63-8bc5-937972339f1e" returned: 0 in 0.277s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.981s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1890427526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f212305a-0329-4315-9ed6-7a93d8cd9ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9456dc574f499eb5ef07e5611ae614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:56Z,use_quota=True,user_id='4ffcfee0d91642fd83d614829e463de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Creating volume f212305a-0329-4315-9ed6-7a93d8cd9ae9 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:16:57 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f212305a-0329-4315-9ed6-7a93d8cd9ae9 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b5aef9-083c-43f9-83b2-6604cc0797e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a403a10c-fb85-4a63-8bc5-937972339f1e', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e183d7-60fa-4da1-946b-77b026134589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:57 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f212305a-0329-4315-9ed6-7a93d8cd9ae9 1073741824 Sep 05 05:16:57 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:57 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Volume volume-a403a10c-fb85-4a63-8bc5-937972339f1e (a403a10c-fb85-4a63-8bc5-937972339f1e): created successfully Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e183d7-60fa-4da1-946b-77b026134589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Flow 'volume_create_manager' (c24ad5a7-4c49-42c4-be60-8d74aee07670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:57 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-38d0d386-6d5d-4039-b800-1219c1e1b539 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Created volume successfully. Sep 05 05:16:57 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f212305a-0329-4315-9ed6-7a93d8cd9ae9 1073741824" returned: 0 in 0.429s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f212305a-0329-4315-9ed6-7a93d8cd9ae9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:57 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f212305a-0329-4315-9ed6-7a93d8cd9ae9 Sep 05 05:16:57 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:57 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f212305a-0329-4315-9ed6-7a93d8cd9ae9" returned: 0 in 0.314s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.343s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1193765451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8924ecb9-a7fd-412e-8b82-560a4e8305ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9456dc574f499eb5ef07e5611ae614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:56Z,use_quota=True,user_id='4ffcfee0d91642fd83d614829e463de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Creating volume 8924ecb9-a7fd-412e-8b82-560a4e8305ef {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:16:57 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8924ecb9-a7fd-412e-8b82-560a4e8305ef 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d98aecb-9122-496d-b137-1b312552e0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f212305a-0329-4315-9ed6-7a93d8cd9ae9', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2abc76b-a8a9-499f-bc1f-017d4f5c2830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:57 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8924ecb9-a7fd-412e-8b82-560a4e8305ef 1073741824 Sep 05 05:16:57 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:57 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Volume volume-f212305a-0329-4315-9ed6-7a93d8cd9ae9 (f212305a-0329-4315-9ed6-7a93d8cd9ae9): created successfully Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2abc76b-a8a9-499f-bc1f-017d4f5c2830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Flow 'volume_create_manager' (9d3f3800-9ff1-418a-8c68-6525930a44cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:58 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-8bb98764-13b7-4aa6-85ab-1c4874214523 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Created volume successfully. Sep 05 05:16:58 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8924ecb9-a7fd-412e-8b82-560a4e8305ef 1073741824" returned: 0 in 0.500s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8924ecb9-a7fd-412e-8b82-560a4e8305ef {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:58 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8924ecb9-a7fd-412e-8b82-560a4e8305ef Sep 05 05:16:58 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:58 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8924ecb9-a7fd-412e-8b82-560a4e8305ef" returned: 0 in 0.279s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:16:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.697s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1999640865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef912fbf-da1c-4f18-bb7b-f2d14b401dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9456dc574f499eb5ef07e5611ae614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:16:57Z,use_quota=True,user_id='4ffcfee0d91642fd83d614829e463de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:16:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Creating volume ef912fbf-da1c-4f18-bb7b-f2d14b401dfe {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:16:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:16:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:16:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:16:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:16:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:16:58 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:16:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef912fbf-da1c-4f18-bb7b-f2d14b401dfe 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:58 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef912fbf-da1c-4f18-bb7b-f2d14b401dfe 1073741824 Sep 05 05:16:58 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14f9ca96-cc20-45bc-8a9a-8bea6ecf400f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8924ecb9-a7fd-412e-8b82-560a4e8305ef', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d98076-afc5-44b9-816e-33e9317e649b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:58 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Volume volume-8924ecb9-a7fd-412e-8b82-560a4e8305ef (8924ecb9-a7fd-412e-8b82-560a4e8305ef): created successfully Sep 05 05:16:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d98076-afc5-44b9-816e-33e9317e649b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Flow 'volume_create_manager' (35706b14-ab99-43b5-b9b6-ed0cc65f2580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:58 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-003bdbf4-8ee2-40fc-9008-75a927231197 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Created volume successfully. Sep 05 05:16:59 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef912fbf-da1c-4f18-bb7b-f2d14b401dfe 1073741824" returned: 0 in 0.457s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef912fbf-da1c-4f18-bb7b-f2d14b401dfe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:16:59 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef912fbf-da1c-4f18-bb7b-f2d14b401dfe Sep 05 05:16:59 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:16:59 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Sep 05 05:16:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef912fbf-da1c-4f18-bb7b-f2d14b401dfe" returned: 0 in 0.269s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:16:59 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:16:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:16:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b7090e-242b-49a4-adec-3f8c88f94a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef912fbf-da1c-4f18-bb7b-f2d14b401dfe', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad38ab4-9be7-4a88-bb51-0236c2a8ff26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:16:59 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Volume volume-ef912fbf-da1c-4f18-bb7b-f2d14b401dfe (ef912fbf-da1c-4f18-bb7b-f2d14b401dfe): created successfully Sep 05 05:16:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad38ab4-9be7-4a88-bb51-0236c2a8ff26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:16:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Flow 'volume_create_manager' (a2584b32-0bd0-4876-9e92-a0fd8bce77c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:16:59 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ec9d6f1e-40c0-41c7-9716-a5cc49d43168 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Created volume successfully. Sep 05 05:17:00 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ee6dce94-b27b-4759-8ca8-6278a5016445 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "cinder-ef912fbf-da1c-4f18-bb7b-f2d14b401dfe-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:17:00 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ee6dce94-b27b-4759-8ca8-6278a5016445 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-ef912fbf-da1c-4f18-bb7b-f2d14b401dfe-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:17:00 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ee6dce94-b27b-4759-8ca8-6278a5016445 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "cinder-quobyte-ef912fbf-da1c-4f18-bb7b-f2d14b401dfe" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:17:00 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ee6dce94-b27b-4759-8ca8-6278a5016445 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-quobyte-ef912fbf-da1c-4f18-bb7b-f2d14b401dfe" acquired by "delete_volume" :: waited 0.017s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:17:00 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f2bff7-233f-4f38-bf6c-3cf9246d25a8]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:17:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ee6dce94-b27b-4759-8ca8-6278a5016445 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef912fbf-da1c-4f18-bb7b-f2d14b401dfe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:00 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef912fbf-da1c-4f18-bb7b-f2d14b401dfe Sep 05 05:17:00 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:00 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ee6dce94-b27b-4759-8ca8-6278a5016445 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef912fbf-da1c-4f18-bb7b-f2d14b401dfe" returned: 0 in 0.386s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ee6dce94-b27b-4759-8ca8-6278a5016445 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef912fbf-da1c-4f18-bb7b-f2d14b401dfe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:00 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef912fbf-da1c-4f18-bb7b-f2d14b401dfe Sep 05 05:17:00 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:01 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ee6dce94-b27b-4759-8ca8-6278a5016445 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ef912fbf-da1c-4f18-bb7b-f2d14b401dfe" returned: 0 in 0.256s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ee6dce94-b27b-4759-8ca8-6278a5016445 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-quobyte-ef912fbf-da1c-4f18-bb7b-f2d14b401dfe" released by "delete_volume" :: held 0.687s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:17:01 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-ee6dce94-b27b-4759-8ca8-6278a5016445 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Created reservations ['43c588b7-531f-4c30-ab59-6c5d4f4bad35', '751f4744-3a19-4060-a01e-4efdeecabef9', 'cba1ddc2-5874-46a3-b31d-952e532e6174', 'cc7cee24-4a14-4d1b-8b5e-c813355f1ca4'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:17:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ee6dce94-b27b-4759-8ca8-6278a5016445 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ee6dce94-b27b-4759-8ca8-6278a5016445 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ee6dce94-b27b-4759-8ca8-6278a5016445 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:17:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ee6dce94-b27b-4759-8ca8-6278a5016445 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:17:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ee6dce94-b27b-4759-8ca8-6278a5016445 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ee6dce94-b27b-4759-8ca8-6278a5016445 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:01 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:17:01 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:01 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ee6dce94-b27b-4759-8ca8-6278a5016445 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.260s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:01 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-ee6dce94-b27b-4759-8ca8-6278a5016445 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:17:01 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ee6dce94-b27b-4759-8ca8-6278a5016445 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Deleted volume successfully. Sep 05 05:17:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ee6dce94-b27b-4759-8ca8-6278a5016445 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-ef912fbf-da1c-4f18-bb7b-f2d14b401dfe-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:17:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-46de02c2-045b-40ee-b4eb-f14c3daa761d tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "cinder-8924ecb9-a7fd-412e-8b82-560a4e8305ef-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:17:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-46de02c2-045b-40ee-b4eb-f14c3daa761d tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-8924ecb9-a7fd-412e-8b82-560a4e8305ef-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:17:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-46de02c2-045b-40ee-b4eb-f14c3daa761d tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "cinder-quobyte-8924ecb9-a7fd-412e-8b82-560a4e8305ef" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:17:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-46de02c2-045b-40ee-b4eb-f14c3daa761d tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-quobyte-8924ecb9-a7fd-412e-8b82-560a4e8305ef" acquired by "delete_volume" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:17:01 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6838ce-51fe-41a7-8873-fdd9cd2613d5]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:17:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-46de02c2-045b-40ee-b4eb-f14c3daa761d tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8924ecb9-a7fd-412e-8b82-560a4e8305ef {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:01 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8924ecb9-a7fd-412e-8b82-560a4e8305ef Sep 05 05:17:01 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:02 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-46de02c2-045b-40ee-b4eb-f14c3daa761d tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8924ecb9-a7fd-412e-8b82-560a4e8305ef" returned: 0 in 0.382s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-46de02c2-045b-40ee-b4eb-f14c3daa761d tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8924ecb9-a7fd-412e-8b82-560a4e8305ef {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:02 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8924ecb9-a7fd-412e-8b82-560a4e8305ef Sep 05 05:17:02 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:02 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-46de02c2-045b-40ee-b4eb-f14c3daa761d tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-8924ecb9-a7fd-412e-8b82-560a4e8305ef" returned: 0 in 0.267s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:02 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-46de02c2-045b-40ee-b4eb-f14c3daa761d tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-quobyte-8924ecb9-a7fd-412e-8b82-560a4e8305ef" released by "delete_volume" :: held 0.689s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:17:02 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-46de02c2-045b-40ee-b4eb-f14c3daa761d tempest-CreateVolumesFromSnapshotTest-1097533248 None] Created reservations ['7073cc62-aebd-4764-b425-0dbdb9e06287', 'f447f098-2672-4669-98b3-683ad48c6d5c', 'b57b9de9-72c5-4bbc-b4cf-22440552a1e2', 'da9b2596-834f-4b95-88d8-f8e3bd7efc6d'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:17:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-46de02c2-045b-40ee-b4eb-f14c3daa761d tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-46de02c2-045b-40ee-b4eb-f14c3daa761d tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-46de02c2-045b-40ee-b4eb-f14c3daa761d tempest-CreateVolumesFromSnapshotTest-1097533248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:17:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-46de02c2-045b-40ee-b4eb-f14c3daa761d tempest-CreateVolumesFromSnapshotTest-1097533248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:17:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-46de02c2-045b-40ee-b4eb-f14c3daa761d tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-46de02c2-045b-40ee-b4eb-f14c3daa761d tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:02 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:17:02 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:02 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:02 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-438101b1-a91f-40df-8132-4fc4c5d00c32 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "cinder-f212305a-0329-4315-9ed6-7a93d8cd9ae9-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:17:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-46de02c2-045b-40ee-b4eb-f14c3daa761d tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.292s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:02 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-46de02c2-045b-40ee-b4eb-f14c3daa761d tempest-CreateVolumesFromSnapshotTest-1097533248 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:17:02 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-46de02c2-045b-40ee-b4eb-f14c3daa761d tempest-CreateVolumesFromSnapshotTest-1097533248 None] Deleted volume successfully. Sep 05 05:17:02 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-438101b1-a91f-40df-8132-4fc4c5d00c32 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-f212305a-0329-4315-9ed6-7a93d8cd9ae9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:17:02 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-46de02c2-045b-40ee-b4eb-f14c3daa761d tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-8924ecb9-a7fd-412e-8b82-560a4e8305ef-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:17:02 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-438101b1-a91f-40df-8132-4fc4c5d00c32 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "cinder-quobyte-f212305a-0329-4315-9ed6-7a93d8cd9ae9" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:17:02 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-438101b1-a91f-40df-8132-4fc4c5d00c32 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-quobyte-f212305a-0329-4315-9ed6-7a93d8cd9ae9" acquired by "delete_volume" :: waited 0.016s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:17:02 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddbc655-6bb9-4e26-a15f-c41ba5e14aa7]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:17:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-438101b1-a91f-40df-8132-4fc4c5d00c32 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f212305a-0329-4315-9ed6-7a93d8cd9ae9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:03 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f212305a-0329-4315-9ed6-7a93d8cd9ae9 Sep 05 05:17:03 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:03 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-438101b1-a91f-40df-8132-4fc4c5d00c32 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f212305a-0329-4315-9ed6-7a93d8cd9ae9" returned: 0 in 0.372s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-438101b1-a91f-40df-8132-4fc4c5d00c32 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f212305a-0329-4315-9ed6-7a93d8cd9ae9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:03 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f212305a-0329-4315-9ed6-7a93d8cd9ae9 Sep 05 05:17:03 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:03 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-438101b1-a91f-40df-8132-4fc4c5d00c32 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f212305a-0329-4315-9ed6-7a93d8cd9ae9" returned: 0 in 0.262s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-438101b1-a91f-40df-8132-4fc4c5d00c32 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-quobyte-f212305a-0329-4315-9ed6-7a93d8cd9ae9" released by "delete_volume" :: held 0.683s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:17:03 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-438101b1-a91f-40df-8132-4fc4c5d00c32 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Created reservations ['0fb567f2-fd58-4737-8b78-ca75c631e173', '383ae0df-d214-464b-a905-eb1d3cb2a376', '589d1273-4208-42fa-90e0-bced6b9ba1ad', '8deee9ae-b2c5-4e75-bc32-0ca6883c766f'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:17:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-438101b1-a91f-40df-8132-4fc4c5d00c32 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-438101b1-a91f-40df-8132-4fc4c5d00c32 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-438101b1-a91f-40df-8132-4fc4c5d00c32 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:17:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-438101b1-a91f-40df-8132-4fc4c5d00c32 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:17:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-438101b1-a91f-40df-8132-4fc4c5d00c32 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-438101b1-a91f-40df-8132-4fc4c5d00c32 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:03 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:17:03 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-76036d35-32b3-4926-aaa0-9f4ed32ee973 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "cinder-a403a10c-fb85-4a63-8bc5-937972339f1e-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:17:03 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-438101b1-a91f-40df-8132-4fc4c5d00c32 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.280s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:03 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-438101b1-a91f-40df-8132-4fc4c5d00c32 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:17:03 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-438101b1-a91f-40df-8132-4fc4c5d00c32 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Deleted volume successfully. Sep 05 05:17:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-76036d35-32b3-4926-aaa0-9f4ed32ee973 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-a403a10c-fb85-4a63-8bc5-937972339f1e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:17:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-438101b1-a91f-40df-8132-4fc4c5d00c32 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-f212305a-0329-4315-9ed6-7a93d8cd9ae9-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:17:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-76036d35-32b3-4926-aaa0-9f4ed32ee973 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "cinder-quobyte-a403a10c-fb85-4a63-8bc5-937972339f1e" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:17:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-76036d35-32b3-4926-aaa0-9f4ed32ee973 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-quobyte-a403a10c-fb85-4a63-8bc5-937972339f1e" acquired by "delete_volume" :: waited 0.016s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:17:04 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fb322f-0a16-49e8-9791-5257455994e4]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:17:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-76036d35-32b3-4926-aaa0-9f4ed32ee973 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a403a10c-fb85-4a63-8bc5-937972339f1e {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:04 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a403a10c-fb85-4a63-8bc5-937972339f1e Sep 05 05:17:04 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:04 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-76036d35-32b3-4926-aaa0-9f4ed32ee973 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a403a10c-fb85-4a63-8bc5-937972339f1e" returned: 0 in 0.410s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-76036d35-32b3-4926-aaa0-9f4ed32ee973 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a403a10c-fb85-4a63-8bc5-937972339f1e {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:04 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a403a10c-fb85-4a63-8bc5-937972339f1e Sep 05 05:17:04 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:04 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-76036d35-32b3-4926-aaa0-9f4ed32ee973 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a403a10c-fb85-4a63-8bc5-937972339f1e" returned: 0 in 0.261s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-76036d35-32b3-4926-aaa0-9f4ed32ee973 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-quobyte-a403a10c-fb85-4a63-8bc5-937972339f1e" released by "delete_volume" :: held 0.708s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:17:04 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-76036d35-32b3-4926-aaa0-9f4ed32ee973 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Created reservations ['204a4e4c-348d-4715-afe8-0a31482e54ed', 'faa49579-ce8b-4ac5-8881-928611cf3da6', 'e0a55063-a22a-4c6b-a10b-fcfd75eff4fc', '671876fa-4b98-4c4c-9093-81983f8d5ae8'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:17:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-76036d35-32b3-4926-aaa0-9f4ed32ee973 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-76036d35-32b3-4926-aaa0-9f4ed32ee973 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-76036d35-32b3-4926-aaa0-9f4ed32ee973 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:17:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-76036d35-32b3-4926-aaa0-9f4ed32ee973 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:17:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-76036d35-32b3-4926-aaa0-9f4ed32ee973 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-76036d35-32b3-4926-aaa0-9f4ed32ee973 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:04 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:17:04 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:05 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-76036d35-32b3-4926-aaa0-9f4ed32ee973 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.260s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:05 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-76036d35-32b3-4926-aaa0-9f4ed32ee973 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:17:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-42322db3-6408-43c6-a785-dbf03f174fba tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "cinder-c67163e4-c8a4-4c9c-9691-1038fd32411c-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:17:05 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-76036d35-32b3-4926-aaa0-9f4ed32ee973 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Deleted volume successfully. Sep 05 05:17:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-42322db3-6408-43c6-a785-dbf03f174fba tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-c67163e4-c8a4-4c9c-9691-1038fd32411c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:17:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-76036d35-32b3-4926-aaa0-9f4ed32ee973 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-a403a10c-fb85-4a63-8bc5-937972339f1e-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:17:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-42322db3-6408-43c6-a785-dbf03f174fba tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "cinder-quobyte-c67163e4-c8a4-4c9c-9691-1038fd32411c" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:17:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-42322db3-6408-43c6-a785-dbf03f174fba tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-quobyte-c67163e4-c8a4-4c9c-9691-1038fd32411c" acquired by "delete_volume" :: waited 0.014s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:17:05 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[1186cf77-b819-4b34-aa42-fbc43e22e7b8]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:17:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-42322db3-6408-43c6-a785-dbf03f174fba tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c67163e4-c8a4-4c9c-9691-1038fd32411c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:05 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c67163e4-c8a4-4c9c-9691-1038fd32411c Sep 05 05:17:05 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:05 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-42322db3-6408-43c6-a785-dbf03f174fba tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c67163e4-c8a4-4c9c-9691-1038fd32411c" returned: 0 in 0.392s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-42322db3-6408-43c6-a785-dbf03f174fba tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c67163e4-c8a4-4c9c-9691-1038fd32411c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:05 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c67163e4-c8a4-4c9c-9691-1038fd32411c Sep 05 05:17:05 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:05 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-42322db3-6408-43c6-a785-dbf03f174fba tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c67163e4-c8a4-4c9c-9691-1038fd32411c" returned: 0 in 0.250s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-42322db3-6408-43c6-a785-dbf03f174fba tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-quobyte-c67163e4-c8a4-4c9c-9691-1038fd32411c" released by "delete_volume" :: held 0.682s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:17:05 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-42322db3-6408-43c6-a785-dbf03f174fba tempest-CreateVolumesFromSnapshotTest-1097533248 None] Created reservations ['097061d1-9cc8-4eba-8e6c-62428cde5450', '67ec447e-b61a-4d6e-8251-5487c42e2961', '906be5f6-d2c3-4fa3-b242-c81c772dfcc3', '381d0259-f5cd-4c59-9b5e-92ee5e82f7e4'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:17:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-42322db3-6408-43c6-a785-dbf03f174fba tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-42322db3-6408-43c6-a785-dbf03f174fba tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-42322db3-6408-43c6-a785-dbf03f174fba tempest-CreateVolumesFromSnapshotTest-1097533248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:17:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-42322db3-6408-43c6-a785-dbf03f174fba tempest-CreateVolumesFromSnapshotTest-1097533248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:17:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-42322db3-6408-43c6-a785-dbf03f174fba tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-42322db3-6408-43c6-a785-dbf03f174fba tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:06 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:17:06 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:06 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-42322db3-6408-43c6-a785-dbf03f174fba tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.258s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:06 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-42322db3-6408-43c6-a785-dbf03f174fba tempest-CreateVolumesFromSnapshotTest-1097533248 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:17:06 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-42322db3-6408-43c6-a785-dbf03f174fba tempest-CreateVolumesFromSnapshotTest-1097533248 None] Deleted volume successfully. Sep 05 05:17:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6c516ca9-e3f7-402a-8a62-22fea42bb39c tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "cinder-fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:17:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-42322db3-6408-43c6-a785-dbf03f174fba tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-c67163e4-c8a4-4c9c-9691-1038fd32411c-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:17:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6c516ca9-e3f7-402a-8a62-22fea42bb39c tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:17:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6c516ca9-e3f7-402a-8a62-22fea42bb39c tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "cinder-quobyte-807449b0-b4b8-49fb-bc01-8bde35ee98e2" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:17:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6c516ca9-e3f7-402a-8a62-22fea42bb39c tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-quobyte-807449b0-b4b8-49fb-bc01-8bde35ee98e2" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:17:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6c516ca9-e3f7-402a-8a62-22fea42bb39c tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "cinder-quobyte-fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:17:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6c516ca9-e3f7-402a-8a62-22fea42bb39c tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-quobyte-fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:17:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-6c516ca9-e3f7-402a-8a62-22fea42bb39c tempest-CreateVolumesFromSnapshotTest-1097533248 None] Deleting offline snapshot fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708 of volume 807449b0-b4b8-49fb-bc01-8bde35ee98e2 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:17:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-6c516ca9-e3f7-402a-8a62-22fea42bb39c tempest-CreateVolumesFromSnapshotTest-1097533248 None] snapshot_file for this snap is: volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:17:06 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57260d5-82a3-4ddb-8527-7091a3ae9784]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:17:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6c516ca9-e3f7-402a-8a62-22fea42bb39c tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:06 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708 Sep 05 05:17:06 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:06 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6c516ca9-e3f7-402a-8a62-22fea42bb39c tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708" returned: 0 in 0.369s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-6c516ca9-e3f7-402a-8a62-22fea42bb39c tempest-CreateVolumesFromSnapshotTest-1097533248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:17:06 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ade2a0-2890-4a2d-940f-02ef0db1a53f]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:17:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6c516ca9-e3f7-402a-8a62-22fea42bb39c tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:07 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2 Sep 05 05:17:07 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:07 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6c516ca9-e3f7-402a-8a62-22fea42bb39c tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2" returned: 0 in 0.361s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6c516ca9-e3f7-402a-8a62-22fea42bb39c tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:07 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708 Sep 05 05:17:07 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:07 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6c516ca9-e3f7-402a-8a62-22fea42bb39c tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708" returned: 0 in 0.367s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6c516ca9-e3f7-402a-8a62-22fea42bb39c tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:07 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708 Sep 05 05:17:07 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:07 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6c516ca9-e3f7-402a-8a62-22fea42bb39c tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2.fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708" returned: 0 in 0.248s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6c516ca9-e3f7-402a-8a62-22fea42bb39c tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-quobyte-fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708" released by "_delete_snapshot" :: held 1.476s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:17:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6c516ca9-e3f7-402a-8a62-22fea42bb39c tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-quobyte-807449b0-b4b8-49fb-bc01-8bde35ee98e2" released by "delete_snapshot" :: held 1.502s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:17:07 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-6c516ca9-e3f7-402a-8a62-22fea42bb39c tempest-CreateVolumesFromSnapshotTest-1097533248 None] Created reservations ['87fec180-503b-4f9e-bd82-3765dcca91db', '730df478-f7d0-4237-abdf-6948833a61c3', 'f0846a99-809c-4bc7-a230-8835eefe4f3d', 'a27a37d9-01e1-4839-96dd-ab98ab05e1f8'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:17:08 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-6c516ca9-e3f7-402a-8a62-22fea42bb39c tempest-CreateVolumesFromSnapshotTest-1097533248 None] Delete snapshot completed successfully. Sep 05 05:17:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-6c516ca9-e3f7-402a-8a62-22fea42bb39c tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-fd36c41b-b7fd-4d88-8b5f-3d3f0b2f3708-delete_snapshot" released by "delete_snapshot" :: held 1.648s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:17:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0622966a-41fc-4b3c-907f-79d1cde577e2 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "cinder-807449b0-b4b8-49fb-bc01-8bde35ee98e2-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:17:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0622966a-41fc-4b3c-907f-79d1cde577e2 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-807449b0-b4b8-49fb-bc01-8bde35ee98e2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:17:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0622966a-41fc-4b3c-907f-79d1cde577e2 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "cinder-quobyte-807449b0-b4b8-49fb-bc01-8bde35ee98e2" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:17:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0622966a-41fc-4b3c-907f-79d1cde577e2 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-quobyte-807449b0-b4b8-49fb-bc01-8bde35ee98e2" acquired by "delete_volume" :: waited 0.015s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:17:08 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe8c955-419e-444c-9031-4fe211da3eaf]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:17:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0622966a-41fc-4b3c-907f-79d1cde577e2 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:08 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2 Sep 05 05:17:08 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:09 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0622966a-41fc-4b3c-907f-79d1cde577e2 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2" returned: 0 in 0.363s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0622966a-41fc-4b3c-907f-79d1cde577e2 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:09 devstack sudo[104735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2 Sep 05 05:17:09 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:09 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0622966a-41fc-4b3c-907f-79d1cde577e2 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-807449b0-b4b8-49fb-bc01-8bde35ee98e2" returned: 0 in 0.242s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0622966a-41fc-4b3c-907f-79d1cde577e2 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-quobyte-807449b0-b4b8-49fb-bc01-8bde35ee98e2" released by "delete_volume" :: held 0.659s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:17:09 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-0622966a-41fc-4b3c-907f-79d1cde577e2 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Created reservations ['d7d1cff4-0e62-4f1e-ba35-17b2a139306a', 'b3d2fe1d-8dd8-40d6-9472-660a73385c62', 'c8e4f3bc-4dc7-40af-b796-cd2de2f10745', 'ac946280-ebc2-44c3-9d6e-ed2b8a669ad5'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:17:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0622966a-41fc-4b3c-907f-79d1cde577e2 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0622966a-41fc-4b3c-907f-79d1cde577e2 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0622966a-41fc-4b3c-907f-79d1cde577e2 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:17:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0622966a-41fc-4b3c-907f-79d1cde577e2 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:17:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0622966a-41fc-4b3c-907f-79d1cde577e2 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0622966a-41fc-4b3c-907f-79d1cde577e2 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:09 devstack sudo[104738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:17:09 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:09 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0622966a-41fc-4b3c-907f-79d1cde577e2 tempest-CreateVolumesFromSnapshotTest-1097533248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.289s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:09 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-0622966a-41fc-4b3c-907f-79d1cde577e2 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:17:09 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-0622966a-41fc-4b3c-907f-79d1cde577e2 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Deleted volume successfully. Sep 05 05:17:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0622966a-41fc-4b3c-907f-79d1cde577e2 tempest-CreateVolumesFromSnapshotTest-1097533248 None] Lock "cinder-807449b0-b4b8-49fb-bc01-8bde35ee98e2-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:17:18 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:17:18 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Flow 'volume_create_manager' (5b0d5b90-5238-4e73-8b9c-2509e182f588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:17:18 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208a601b-5fef-45fb-8b82-a79c993c338c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:18 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208a601b-5fef-45fb-8b82-a79c993c338c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1920249563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=296befc4-46d9-40a6-937f-dee45ae03375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='699f157af33045e2a13eb2201c792260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:17:19Z,use_quota=True,user_id='28da54694b614b9193456c9e3f3329b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:18 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea2fad22-3a4e-4d79-b7e6-f402b19b1529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:18 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea2fad22-3a4e-4d79-b7e6-f402b19b1529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:18 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec63d321-5f6f-43c3-9073-9a3872367101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:18 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec63d321-5f6f-43c3-9073-9a3872367101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '296befc4-46d9-40a6-937f-dee45ae03375', 'volume_name': 'volume-296befc4-46d9-40a6-937f-dee45ae03375', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:18 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66a3a0f-64ed-4f1b-9957-2495b05a8b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:18 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66a3a0f-64ed-4f1b-9957-2495b05a8b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:18 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50fc5ab-a704-4908-94be-42e27a545886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:18 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Volume 296befc4-46d9-40a6-937f-dee45ae03375: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-296befc4-46d9-40a6-937f-dee45ae03375', 'volume_size': 1} Sep 05 05:17:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:18 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1920249563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=296befc4-46d9-40a6-937f-dee45ae03375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='699f157af33045e2a13eb2201c792260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:17:19Z,use_quota=True,user_id='28da54694b614b9193456c9e3f3329b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:17:18 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Creating volume 296befc4-46d9-40a6-937f-dee45ae03375 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:17:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:18 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:17:18 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:17:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:18 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:17:18 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:17:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-296befc4-46d9-40a6-937f-dee45ae03375 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:18 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-296befc4-46d9-40a6-937f-dee45ae03375 1073741824 Sep 05 05:17:18 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:19 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-296befc4-46d9-40a6-937f-dee45ae03375 1073741824" returned: 0 in 0.457s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-296befc4-46d9-40a6-937f-dee45ae03375 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:19 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-296befc4-46d9-40a6-937f-dee45ae03375 Sep 05 05:17:19 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:19 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-296befc4-46d9-40a6-937f-dee45ae03375" returned: 0 in 0.259s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:19 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:17:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50fc5ab-a704-4908-94be-42e27a545886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-296befc4-46d9-40a6-937f-dee45ae03375', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ebe09b-aefa-4a1d-91d0-c6f4f36027c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:19 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Volume volume-296befc4-46d9-40a6-937f-dee45ae03375 (296befc4-46d9-40a6-937f-dee45ae03375): created successfully Sep 05 05:17:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ebe09b-aefa-4a1d-91d0-c6f4f36027c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Flow 'volume_create_manager' (5b0d5b90-5238-4e73-8b9c-2509e182f588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:17:19 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-c4a4e727-fb79-4639-b9d8-75d5bea2a286 tempest-ProjectReaderTests-1732259998 None] Created volume successfully. Sep 05 05:17:21 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-29f00b5b-03a6-45df-ab4f-1903f538e9f0 tempest-ProjectReaderTests-1732259998 None] Acquiring lock "cinder-296befc4-46d9-40a6-937f-dee45ae03375-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:17:21 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-29f00b5b-03a6-45df-ab4f-1903f538e9f0 tempest-ProjectReaderTests-1732259998 None] Lock "cinder-296befc4-46d9-40a6-937f-dee45ae03375-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:17:21 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-29f00b5b-03a6-45df-ab4f-1903f538e9f0 tempest-ProjectReaderTests-1732259998 None] Acquiring lock "cinder-quobyte-296befc4-46d9-40a6-937f-dee45ae03375" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:17:21 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-29f00b5b-03a6-45df-ab4f-1903f538e9f0 tempest-ProjectReaderTests-1732259998 None] Lock "cinder-quobyte-296befc4-46d9-40a6-937f-dee45ae03375" acquired by "delete_volume" :: waited 0.015s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:17:21 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecaea4e-51a5-415c-b418-97d2118b8c6d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:17:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-29f00b5b-03a6-45df-ab4f-1903f538e9f0 tempest-ProjectReaderTests-1732259998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-296befc4-46d9-40a6-937f-dee45ae03375 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:21 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-296befc4-46d9-40a6-937f-dee45ae03375 Sep 05 05:17:21 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:21 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-29f00b5b-03a6-45df-ab4f-1903f538e9f0 tempest-ProjectReaderTests-1732259998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-296befc4-46d9-40a6-937f-dee45ae03375" returned: 0 in 0.377s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-29f00b5b-03a6-45df-ab4f-1903f538e9f0 tempest-ProjectReaderTests-1732259998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-296befc4-46d9-40a6-937f-dee45ae03375 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:21 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-296befc4-46d9-40a6-937f-dee45ae03375 Sep 05 05:17:21 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:21 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-29f00b5b-03a6-45df-ab4f-1903f538e9f0 tempest-ProjectReaderTests-1732259998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-296befc4-46d9-40a6-937f-dee45ae03375" returned: 0 in 0.257s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:21 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-29f00b5b-03a6-45df-ab4f-1903f538e9f0 tempest-ProjectReaderTests-1732259998 None] Lock "cinder-quobyte-296befc4-46d9-40a6-937f-dee45ae03375" released by "delete_volume" :: held 0.684s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:17:21 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-29f00b5b-03a6-45df-ab4f-1903f538e9f0 tempest-ProjectReaderTests-1732259998 None] Created reservations ['d56d2be2-398a-4215-aca2-913a46da5d80', 'a7187cbd-bf94-46f1-8e30-84aa0b2fff00', '6e1eb0ea-8aae-47cf-8448-360da249659d', 'afab0a26-f1a6-4f5a-80da-39e2dd21dfee'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:17:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-29f00b5b-03a6-45df-ab4f-1903f538e9f0 tempest-ProjectReaderTests-1732259998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-29f00b5b-03a6-45df-ab4f-1903f538e9f0 tempest-ProjectReaderTests-1732259998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-29f00b5b-03a6-45df-ab4f-1903f538e9f0 tempest-ProjectReaderTests-1732259998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:17:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-29f00b5b-03a6-45df-ab4f-1903f538e9f0 tempest-ProjectReaderTests-1732259998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:17:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-29f00b5b-03a6-45df-ab4f-1903f538e9f0 tempest-ProjectReaderTests-1732259998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-29f00b5b-03a6-45df-ab4f-1903f538e9f0 tempest-ProjectReaderTests-1732259998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:21 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:17:21 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:22 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-29f00b5b-03a6-45df-ab4f-1903f538e9f0 tempest-ProjectReaderTests-1732259998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.261s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-29f00b5b-03a6-45df-ab4f-1903f538e9f0 tempest-ProjectReaderTests-1732259998 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:17:22 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-29f00b5b-03a6-45df-ab4f-1903f538e9f0 tempest-ProjectReaderTests-1732259998 None] Deleted volume successfully. Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-29f00b5b-03a6-45df-ab4f-1903f538e9f0 tempest-ProjectReaderTests-1732259998 None] Lock "cinder-296befc4-46d9-40a6-937f-dee45ae03375-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Flow 'volume_create_manager' (b81bc524-7402-48f5-9adf-2a2edf65518b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3d3096-bc45-4ed1-9033-8d6f04d45f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3d3096-bc45-4ed1-9033-8d6f04d45f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1563159905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9898a9d2-1283-4386-8f1f-8f5149486468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='699f157af33045e2a13eb2201c792260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:17:23Z,use_quota=True,user_id='28da54694b614b9193456c9e3f3329b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edfa0da7-662f-432c-a9d0-a5c1abebbdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edfa0da7-662f-432c-a9d0-a5c1abebbdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d64ae3-1192-472e-a06f-8dab2e8c1db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d64ae3-1192-472e-a06f-8dab2e8c1db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9898a9d2-1283-4386-8f1f-8f5149486468', 'volume_name': 'volume-9898a9d2-1283-4386-8f1f-8f5149486468', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed656134-6e12-476a-ac8d-800190401344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed656134-6e12-476a-ac8d-800190401344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca293cdd-1523-4bfe-9663-8e1e06cb41b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:22 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Volume 9898a9d2-1283-4386-8f1f-8f5149486468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9898a9d2-1283-4386-8f1f-8f5149486468', 'volume_size': 1} Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1563159905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9898a9d2-1283-4386-8f1f-8f5149486468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='699f157af33045e2a13eb2201c792260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:17:23Z,use_quota=True,user_id='28da54694b614b9193456c9e3f3329b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Creating volume 9898a9d2-1283-4386-8f1f-8f5149486468 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:17:22 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:17:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9898a9d2-1283-4386-8f1f-8f5149486468 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:22 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9898a9d2-1283-4386-8f1f-8f5149486468 1073741824 Sep 05 05:17:22 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:23 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9898a9d2-1283-4386-8f1f-8f5149486468 1073741824" returned: 0 in 0.478s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9898a9d2-1283-4386-8f1f-8f5149486468 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:23 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9898a9d2-1283-4386-8f1f-8f5149486468 Sep 05 05:17:23 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:23 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9898a9d2-1283-4386-8f1f-8f5149486468" returned: 0 in 0.264s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:17:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca293cdd-1523-4bfe-9663-8e1e06cb41b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9898a9d2-1283-4386-8f1f-8f5149486468', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b3e49de-8d8f-47c6-9ecb-9cc12bb25aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:23 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Volume volume-9898a9d2-1283-4386-8f1f-8f5149486468 (9898a9d2-1283-4386-8f1f-8f5149486468): created successfully Sep 05 05:17:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b3e49de-8d8f-47c6-9ecb-9cc12bb25aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Flow 'volume_create_manager' (b81bc524-7402-48f5-9adf-2a2edf65518b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:17:23 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-b7cd31e7-e926-4528-b069-0355834cf9f0 tempest-ProjectReaderTests-1732259998 None] Created volume successfully. Sep 05 05:17:24 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-5b09f979-3efc-4ee7-9dc5-1890ba66c153 tempest-ProjectReaderTests-1732259998 None] Acquiring lock "cinder-9898a9d2-1283-4386-8f1f-8f5149486468-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:17:24 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-5b09f979-3efc-4ee7-9dc5-1890ba66c153 tempest-ProjectReaderTests-1732259998 None] Lock "cinder-9898a9d2-1283-4386-8f1f-8f5149486468-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:17:24 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-5b09f979-3efc-4ee7-9dc5-1890ba66c153 tempest-ProjectReaderTests-1732259998 None] Acquiring lock "cinder-quobyte-9898a9d2-1283-4386-8f1f-8f5149486468" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:17:24 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-5b09f979-3efc-4ee7-9dc5-1890ba66c153 tempest-ProjectReaderTests-1732259998 None] Lock "cinder-quobyte-9898a9d2-1283-4386-8f1f-8f5149486468" acquired by "delete_volume" :: waited 0.021s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:17:25 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae18b5e-f353-43f6-bc98-9ba07b0cee7e]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:17:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5b09f979-3efc-4ee7-9dc5-1890ba66c153 tempest-ProjectReaderTests-1732259998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9898a9d2-1283-4386-8f1f-8f5149486468 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:25 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9898a9d2-1283-4386-8f1f-8f5149486468 Sep 05 05:17:25 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:25 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5b09f979-3efc-4ee7-9dc5-1890ba66c153 tempest-ProjectReaderTests-1732259998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9898a9d2-1283-4386-8f1f-8f5149486468" returned: 0 in 0.403s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5b09f979-3efc-4ee7-9dc5-1890ba66c153 tempest-ProjectReaderTests-1732259998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9898a9d2-1283-4386-8f1f-8f5149486468 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:25 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9898a9d2-1283-4386-8f1f-8f5149486468 Sep 05 05:17:25 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:25 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5b09f979-3efc-4ee7-9dc5-1890ba66c153 tempest-ProjectReaderTests-1732259998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9898a9d2-1283-4386-8f1f-8f5149486468" returned: 0 in 0.250s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:25 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-5b09f979-3efc-4ee7-9dc5-1890ba66c153 tempest-ProjectReaderTests-1732259998 None] Lock "cinder-quobyte-9898a9d2-1283-4386-8f1f-8f5149486468" released by "delete_volume" :: held 0.697s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:17:25 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-5b09f979-3efc-4ee7-9dc5-1890ba66c153 tempest-ProjectReaderTests-1732259998 None] Created reservations ['1ad6b6bc-a0ca-430c-9957-d28a46d501de', 'f1df12b4-4db3-4a75-9c4d-95607d64c7e2', '3e498273-4e69-4a14-889e-58cc2327695f', 'eefde8d0-4afd-426d-b4f1-8f932a717a65'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:17:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5b09f979-3efc-4ee7-9dc5-1890ba66c153 tempest-ProjectReaderTests-1732259998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5b09f979-3efc-4ee7-9dc5-1890ba66c153 tempest-ProjectReaderTests-1732259998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5b09f979-3efc-4ee7-9dc5-1890ba66c153 tempest-ProjectReaderTests-1732259998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:17:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5b09f979-3efc-4ee7-9dc5-1890ba66c153 tempest-ProjectReaderTests-1732259998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:17:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5b09f979-3efc-4ee7-9dc5-1890ba66c153 tempest-ProjectReaderTests-1732259998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5b09f979-3efc-4ee7-9dc5-1890ba66c153 tempest-ProjectReaderTests-1732259998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:25 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:17:25 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:26 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5b09f979-3efc-4ee7-9dc5-1890ba66c153 tempest-ProjectReaderTests-1732259998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.260s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-5b09f979-3efc-4ee7-9dc5-1890ba66c153 tempest-ProjectReaderTests-1732259998 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:17:26 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-5b09f979-3efc-4ee7-9dc5-1890ba66c153 tempest-ProjectReaderTests-1732259998 None] Deleted volume successfully. Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-5b09f979-3efc-4ee7-9dc5-1890ba66c153 tempest-ProjectReaderTests-1732259998 None] Lock "cinder-9898a9d2-1283-4386-8f1f-8f5149486468-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Flow 'volume_create_manager' (e1272e42-22fa-4f25-bfda-2786a8e980f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2163881c-def8-45fe-8cda-8478feb6ef38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2163881c-def8-45fe-8cda-8478feb6ef38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-636496426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50eb9af-78d1-4ffa-9557-72deddab2d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='699f157af33045e2a13eb2201c792260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:17:27Z,use_quota=True,user_id='28da54694b614b9193456c9e3f3329b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf16ef5-c757-426e-b318-135ea86f48a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf16ef5-c757-426e-b318-135ea86f48a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f47fd2-1ebf-4f19-b72e-430c832b5b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f47fd2-1ebf-4f19-b72e-430c832b5b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b50eb9af-78d1-4ffa-9557-72deddab2d7b', 'volume_name': 'volume-b50eb9af-78d1-4ffa-9557-72deddab2d7b', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae86940-f40b-4dc7-ad53-1f1599bb32bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae86940-f40b-4dc7-ad53-1f1599bb32bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0899b4f1-91e4-45e9-a1ca-63a264499874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:26 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Volume b50eb9af-78d1-4ffa-9557-72deddab2d7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b50eb9af-78d1-4ffa-9557-72deddab2d7b', 'volume_size': 1} Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-636496426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50eb9af-78d1-4ffa-9557-72deddab2d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='699f157af33045e2a13eb2201c792260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:17:27Z,use_quota=True,user_id='28da54694b614b9193456c9e3f3329b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Creating volume b50eb9af-78d1-4ffa-9557-72deddab2d7b {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:17:26 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:17:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b50eb9af-78d1-4ffa-9557-72deddab2d7b 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:26 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b50eb9af-78d1-4ffa-9557-72deddab2d7b 1073741824 Sep 05 05:17:26 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:27 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b50eb9af-78d1-4ffa-9557-72deddab2d7b 1073741824" returned: 0 in 0.449s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b50eb9af-78d1-4ffa-9557-72deddab2d7b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:27 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b50eb9af-78d1-4ffa-9557-72deddab2d7b Sep 05 05:17:27 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:27 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b50eb9af-78d1-4ffa-9557-72deddab2d7b" returned: 0 in 0.249s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:17:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0899b4f1-91e4-45e9-a1ca-63a264499874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b50eb9af-78d1-4ffa-9557-72deddab2d7b', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e3e4cf-dab4-4cc3-981a-55bb08fceeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:27 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Volume volume-b50eb9af-78d1-4ffa-9557-72deddab2d7b (b50eb9af-78d1-4ffa-9557-72deddab2d7b): created successfully Sep 05 05:17:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e3e4cf-dab4-4cc3-981a-55bb08fceeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Flow 'volume_create_manager' (e1272e42-22fa-4f25-bfda-2786a8e980f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:17:27 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-b9c10c9f-6618-42f5-866e-4264bb0ae0b4 tempest-ProjectReaderTests-1732259998 None] Created volume successfully. Sep 05 05:17:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0f323f9f-b1cd-46a5-b22f-19bca81ac22e tempest-ProjectReaderTests-1732259998 None] Acquiring lock "cinder-b50eb9af-78d1-4ffa-9557-72deddab2d7b-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:17:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0f323f9f-b1cd-46a5-b22f-19bca81ac22e tempest-ProjectReaderTests-1732259998 None] Lock "cinder-b50eb9af-78d1-4ffa-9557-72deddab2d7b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:17:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0f323f9f-b1cd-46a5-b22f-19bca81ac22e tempest-ProjectReaderTests-1732259998 None] Acquiring lock "cinder-quobyte-b50eb9af-78d1-4ffa-9557-72deddab2d7b" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:17:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0f323f9f-b1cd-46a5-b22f-19bca81ac22e tempest-ProjectReaderTests-1732259998 None] Lock "cinder-quobyte-b50eb9af-78d1-4ffa-9557-72deddab2d7b" acquired by "delete_volume" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:17:27 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5553abb7-1d05-4472-a173-b48e2c13b0c4]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:17:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0f323f9f-b1cd-46a5-b22f-19bca81ac22e tempest-ProjectReaderTests-1732259998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b50eb9af-78d1-4ffa-9557-72deddab2d7b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:27 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b50eb9af-78d1-4ffa-9557-72deddab2d7b Sep 05 05:17:27 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Flow 'volume_create_manager' (7ea51ed0-b96d-46af-9963-b3599339057a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c7f432-ac5e-4015-a825-008840cbfbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:28 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0f323f9f-b1cd-46a5-b22f-19bca81ac22e tempest-ProjectReaderTests-1732259998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b50eb9af-78d1-4ffa-9557-72deddab2d7b" returned: 0 in 0.421s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0f323f9f-b1cd-46a5-b22f-19bca81ac22e tempest-ProjectReaderTests-1732259998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b50eb9af-78d1-4ffa-9557-72deddab2d7b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c7f432-ac5e-4015-a825-008840cbfbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-458593818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5484355e-c62a-4831-b28a-e203554f5e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530b1fc106cd444ea7f9dc2c186629a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:17:28Z,use_quota=True,user_id='2ace3310be344e96add41f77d4f07311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:28 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b50eb9af-78d1-4ffa-9557-72deddab2d7b Sep 05 05:17:28 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (494ecb7d-df97-4ac2-a7f6-2e4dc06b202a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (494ecb7d-df97-4ac2-a7f6-2e4dc06b202a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46fcdb5-3770-4b21-90b0-cade5bcd145c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46fcdb5-3770-4b21-90b0-cade5bcd145c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5484355e-c62a-4831-b28a-e203554f5e57', 'volume_name': 'volume-5484355e-c62a-4831-b28a-e203554f5e57', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7acc0ea7-c57b-40ac-80c1-ab0239729f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7acc0ea7-c57b-40ac-80c1-ab0239729f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f3fd41-977d-4d24-8c93-d68248a1fa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:28 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Volume 5484355e-c62a-4831-b28a-e203554f5e57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5484355e-c62a-4831-b28a-e203554f5e57', 'volume_size': 1} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-458593818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5484355e-c62a-4831-b28a-e203554f5e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530b1fc106cd444ea7f9dc2c186629a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:17:28Z,use_quota=True,user_id='2ace3310be344e96add41f77d4f07311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Creating volume 5484355e-c62a-4831-b28a-e203554f5e57 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:17:28 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:28 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57 1073741824 Sep 05 05:17:28 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:28 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0f323f9f-b1cd-46a5-b22f-19bca81ac22e tempest-ProjectReaderTests-1732259998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b50eb9af-78d1-4ffa-9557-72deddab2d7b" returned: 0 in 0.278s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0f323f9f-b1cd-46a5-b22f-19bca81ac22e tempest-ProjectReaderTests-1732259998 None] Lock "cinder-quobyte-b50eb9af-78d1-4ffa-9557-72deddab2d7b" released by "delete_volume" :: held 0.747s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-0f323f9f-b1cd-46a5-b22f-19bca81ac22e tempest-ProjectReaderTests-1732259998 None] Created reservations ['9464a9e0-cd4f-48bd-a0ac-a7c4f72ac1b2', 'e08d162a-8f9b-4316-a186-be2f3f818199', '9fc7048b-e395-496c-a359-57951ae0bc96', '98956ffa-4289-47a5-84c1-a2a238dfa136'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0f323f9f-b1cd-46a5-b22f-19bca81ac22e tempest-ProjectReaderTests-1732259998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0f323f9f-b1cd-46a5-b22f-19bca81ac22e tempest-ProjectReaderTests-1732259998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0f323f9f-b1cd-46a5-b22f-19bca81ac22e tempest-ProjectReaderTests-1732259998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0f323f9f-b1cd-46a5-b22f-19bca81ac22e tempest-ProjectReaderTests-1732259998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0f323f9f-b1cd-46a5-b22f-19bca81ac22e tempest-ProjectReaderTests-1732259998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0f323f9f-b1cd-46a5-b22f-19bca81ac22e tempest-ProjectReaderTests-1732259998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:28 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:17:28 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:28 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57 1073741824" returned: 0 in 0.539s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:28 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57 Sep 05 05:17:28 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:28 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0f323f9f-b1cd-46a5-b22f-19bca81ac22e tempest-ProjectReaderTests-1732259998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.319s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:28 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-0f323f9f-b1cd-46a5-b22f-19bca81ac22e tempest-ProjectReaderTests-1732259998 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:17:29 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-0f323f9f-b1cd-46a5-b22f-19bca81ac22e tempest-ProjectReaderTests-1732259998 None] Deleted volume successfully. Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0f323f9f-b1cd-46a5-b22f-19bca81ac22e tempest-ProjectReaderTests-1732259998 None] Lock "cinder-b50eb9af-78d1-4ffa-9557-72deddab2d7b-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:17:29 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57" returned: 0 in 0.321s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f3fd41-977d-4d24-8c93-d68248a1fa68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5484355e-c62a-4831-b28a-e203554f5e57', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1327e148-4abb-4beb-9a35-aace91869188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:29 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Volume volume-5484355e-c62a-4831-b28a-e203554f5e57 (5484355e-c62a-4831-b28a-e203554f5e57): created successfully Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1327e148-4abb-4beb-9a35-aace91869188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Flow 'volume_create_manager' (7ea51ed0-b96d-46af-9963-b3599339057a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:17:29 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-8367bb99-b8f7-4529-84c5-d98f15dd28e3 tempest-TestStampPattern-583355382 None] Created volume successfully. Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Flow 'volume_create_manager' (085b1e09-d6cf-4d9a-afb2-73822dd4fd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ffe925a-2791-4158-8e03-c746a36ea5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ffe925a-2791-4158-8e03-c746a36ea5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1503533409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff546d26-caef-49eb-bcdb-4eeed499f5c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='699f157af33045e2a13eb2201c792260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:17:29Z,use_quota=True,user_id='28da54694b614b9193456c9e3f3329b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aee4821-0761-4c82-91d2-9d86ca4e1214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aee4821-0761-4c82-91d2-9d86ca4e1214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c34e63eb-06a6-4115-8375-2d23fe437ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c34e63eb-06a6-4115-8375-2d23fe437ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff546d26-caef-49eb-bcdb-4eeed499f5c9', 'volume_name': 'volume-ff546d26-caef-49eb-bcdb-4eeed499f5c9', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9755c442-1ca8-4464-af12-6b40143a48b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9755c442-1ca8-4464-af12-6b40143a48b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc06216e-3d1a-419d-b41a-ce8ae9bd5472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:29 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Volume ff546d26-caef-49eb-bcdb-4eeed499f5c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff546d26-caef-49eb-bcdb-4eeed499f5c9', 'volume_size': 1} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1503533409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff546d26-caef-49eb-bcdb-4eeed499f5c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='699f157af33045e2a13eb2201c792260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:17:29Z,use_quota=True,user_id='28da54694b614b9193456c9e3f3329b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Creating volume ff546d26-caef-49eb-bcdb-4eeed499f5c9 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:17:29 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff546d26-caef-49eb-bcdb-4eeed499f5c9 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:29 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff546d26-caef-49eb-bcdb-4eeed499f5c9 1073741824 Sep 05 05:17:29 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:29 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff546d26-caef-49eb-bcdb-4eeed499f5c9 1073741824" returned: 0 in 0.442s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff546d26-caef-49eb-bcdb-4eeed499f5c9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:30 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff546d26-caef-49eb-bcdb-4eeed499f5c9 Sep 05 05:17:30 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:30 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff546d26-caef-49eb-bcdb-4eeed499f5c9" returned: 0 in 0.304s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:30 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:17:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc06216e-3d1a-419d-b41a-ce8ae9bd5472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff546d26-caef-49eb-bcdb-4eeed499f5c9', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c5a5da-fb2d-46e2-bd4a-ecdac1617fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:30 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Volume volume-ff546d26-caef-49eb-bcdb-4eeed499f5c9 (ff546d26-caef-49eb-bcdb-4eeed499f5c9): created successfully Sep 05 05:17:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c5a5da-fb2d-46e2-bd4a-ecdac1617fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Flow 'volume_create_manager' (085b1e09-d6cf-4d9a-afb2-73822dd4fd40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:17:30 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-fbf695df-371e-45fe-bfaa-91ef997bc714 tempest-ProjectReaderTests-1732259998 None] Created volume successfully. Sep 05 05:17:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4aa40c4f-ea75-41bf-8bf6-fde4840f6949 tempest-ProjectReaderTests-1732259998 None] Acquiring lock "cinder-ff546d26-caef-49eb-bcdb-4eeed499f5c9-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:17:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4aa40c4f-ea75-41bf-8bf6-fde4840f6949 tempest-ProjectReaderTests-1732259998 None] Lock "cinder-ff546d26-caef-49eb-bcdb-4eeed499f5c9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:17:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4aa40c4f-ea75-41bf-8bf6-fde4840f6949 tempest-ProjectReaderTests-1732259998 None] Acquiring lock "cinder-quobyte-ff546d26-caef-49eb-bcdb-4eeed499f5c9" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:17:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4aa40c4f-ea75-41bf-8bf6-fde4840f6949 tempest-ProjectReaderTests-1732259998 None] Lock "cinder-quobyte-ff546d26-caef-49eb-bcdb-4eeed499f5c9" acquired by "delete_volume" :: waited 0.015s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:17:31 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[824c8d1e-bfcb-4c09-b0aa-f1eb4889edce]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:17:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4aa40c4f-ea75-41bf-8bf6-fde4840f6949 tempest-ProjectReaderTests-1732259998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff546d26-caef-49eb-bcdb-4eeed499f5c9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:31 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff546d26-caef-49eb-bcdb-4eeed499f5c9 Sep 05 05:17:31 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:32 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4aa40c4f-ea75-41bf-8bf6-fde4840f6949 tempest-ProjectReaderTests-1732259998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff546d26-caef-49eb-bcdb-4eeed499f5c9" returned: 0 in 0.381s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4aa40c4f-ea75-41bf-8bf6-fde4840f6949 tempest-ProjectReaderTests-1732259998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff546d26-caef-49eb-bcdb-4eeed499f5c9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:32 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff546d26-caef-49eb-bcdb-4eeed499f5c9 Sep 05 05:17:32 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:32 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4aa40c4f-ea75-41bf-8bf6-fde4840f6949 tempest-ProjectReaderTests-1732259998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ff546d26-caef-49eb-bcdb-4eeed499f5c9" returned: 0 in 0.250s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:32 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4aa40c4f-ea75-41bf-8bf6-fde4840f6949 tempest-ProjectReaderTests-1732259998 None] Lock "cinder-quobyte-ff546d26-caef-49eb-bcdb-4eeed499f5c9" released by "delete_volume" :: held 0.688s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:17:32 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-4aa40c4f-ea75-41bf-8bf6-fde4840f6949 tempest-ProjectReaderTests-1732259998 None] Created reservations ['3ac8c479-9082-4a5a-acfe-3cb7533f7324', '6d2f7df5-4ba3-468c-94a8-490492fb139d', '31783597-30e3-41b6-9924-bc5caf3cda17', '172a7a83-1835-4490-8f69-d3bd58c36a95'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:17:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4aa40c4f-ea75-41bf-8bf6-fde4840f6949 tempest-ProjectReaderTests-1732259998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4aa40c4f-ea75-41bf-8bf6-fde4840f6949 tempest-ProjectReaderTests-1732259998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:32 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4aa40c4f-ea75-41bf-8bf6-fde4840f6949 tempest-ProjectReaderTests-1732259998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:17:32 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4aa40c4f-ea75-41bf-8bf6-fde4840f6949 tempest-ProjectReaderTests-1732259998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:17:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4aa40c4f-ea75-41bf-8bf6-fde4840f6949 tempest-ProjectReaderTests-1732259998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4aa40c4f-ea75-41bf-8bf6-fde4840f6949 tempest-ProjectReaderTests-1732259998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:32 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:17:32 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:32 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4aa40c4f-ea75-41bf-8bf6-fde4840f6949 tempest-ProjectReaderTests-1732259998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.309s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:32 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-4aa40c4f-ea75-41bf-8bf6-fde4840f6949 tempest-ProjectReaderTests-1732259998 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:17:32 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-4aa40c4f-ea75-41bf-8bf6-fde4840f6949 tempest-ProjectReaderTests-1732259998 None] Deleted volume successfully. Sep 05 05:17:32 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4aa40c4f-ea75-41bf-8bf6-fde4840f6949 tempest-ProjectReaderTests-1732259998 None] Lock "cinder-ff546d26-caef-49eb-bcdb-4eeed499f5c9-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:17:42 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=85,cinder:INSERT=31,cinder:UPDATE=125,cinder:DELETE=10 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:17:42 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:UPDATE=132,cinder:SELECT=88,cinder:INSERT=29,cinder:DELETE=13 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:17:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:17:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:17:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:17:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:49 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:17:49 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:49 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.238s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:49 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:17:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager._thread_info {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:17:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread count: 29 {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 05:17:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread info: [<_MainThread(MainThread, started 139182109970560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Flow 'volume_create_manager' (59018eab-0386-4e33-bc76-a2e51cc5018c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308a6701-3b28-468a-84dd-4a3862f10cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308a6701-3b28-468a-84dd-4a3862f10cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1628691782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ae04ee-6424-4c60-ac7a-9130fa5d886f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59a197231962420ca6bdd6f85ddcf8a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:17:56Z,use_quota=True,user_id='cb82c28fac4a4161ba5b5440565885ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487e25c1-c2ee-48fb-b6b8-f3473e4d629f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487e25c1-c2ee-48fb-b6b8-f3473e4d629f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07143992-0f28-41a8-830e-d65759057b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07143992-0f28-41a8-830e-d65759057b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36ae04ee-6424-4c60-ac7a-9130fa5d886f', 'volume_name': 'volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8d6e0d8-ed9a-4c55-a3c9-75e23fa84476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8d6e0d8-ed9a-4c55-a3c9-75e23fa84476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179a8196-b521-4cf1-bb8f-bbc9d6f5ea3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:56 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Volume 36ae04ee-6424-4c60-ac7a-9130fa5d886f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f', 'volume_size': 1} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1628691782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ae04ee-6424-4c60-ac7a-9130fa5d886f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59a197231962420ca6bdd6f85ddcf8a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:17:56Z,use_quota=True,user_id='cb82c28fac4a4161ba5b5440565885ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Creating volume 36ae04ee-6424-4c60-ac7a-9130fa5d886f {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:17:56 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:56 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f 1073741824 Sep 05 05:17:56 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:56 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f 1073741824" returned: 0 in 0.405s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:56 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f Sep 05 05:17:56 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:56 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f" returned: 0 in 0.239s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179a8196-b521-4cf1-bb8f-bbc9d6f5ea3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39efb41e-41a8-4ad7-bcaa-26b35f771113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:17:56 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Volume volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f (36ae04ee-6424-4c60-ac7a-9130fa5d886f): created successfully Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39efb41e-41a8-4ad7-bcaa-26b35f771113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:17:56 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Flow 'volume_create_manager' (59018eab-0386-4e33-bc76-a2e51cc5018c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:17:56 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-a42222b6-df9e-48d8-b3a5-f59b87749338 tempest-SnapshotDependencyTests-1604447549 None] Created volume successfully. Sep 05 05:17:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b3052d6a-11cd-463d-8679-a716289445b4 tempest-SnapshotDependencyTests-1604447549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:17:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b3052d6a-11cd-463d-8679-a716289445b4 tempest-SnapshotDependencyTests-1604447549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:17:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-b3052d6a-11cd-463d-8679-a716289445b4 tempest-SnapshotDependencyTests-1604447549 None] Creating offline snapshot 7dcde1fc-aa69-42ca-8a89-08b7419ebdb1 of volume 36ae04ee-6424-4c60-ac7a-9130fa5d886f {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:17:57 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e65b09f-a8d7-4ba7-98c4-8fa7bac7956d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:17:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b3052d6a-11cd-463d-8679-a716289445b4 tempest-SnapshotDependencyTests-1604447549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:57 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f Sep 05 05:17:57 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:57 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b3052d6a-11cd-463d-8679-a716289445b4 tempest-SnapshotDependencyTests-1604447549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f" returned: 0 in 0.342s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b3052d6a-11cd-463d-8679-a716289445b4 tempest-SnapshotDependencyTests-1604447549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.7dcde1fc-aa69-42ca-8a89-08b7419ebdb1 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:57 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.7dcde1fc-aa69-42ca-8a89-08b7419ebdb1 1G Sep 05 05:17:57 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:58 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b3052d6a-11cd-463d-8679-a716289445b4 tempest-SnapshotDependencyTests-1604447549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.7dcde1fc-aa69-42ca-8a89-08b7419ebdb1 1G" returned: 0 in 0.378s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b3052d6a-11cd-463d-8679-a716289445b4 tempest-SnapshotDependencyTests-1604447549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.7dcde1fc-aa69-42ca-8a89-08b7419ebdb1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:58 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.7dcde1fc-aa69-42ca-8a89-08b7419ebdb1 Sep 05 05:17:58 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:58 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b3052d6a-11cd-463d-8679-a716289445b4 tempest-SnapshotDependencyTests-1604447549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.7dcde1fc-aa69-42ca-8a89-08b7419ebdb1" returned: 0 in 0.282s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:58 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-b3052d6a-11cd-463d-8679-a716289445b4 tempest-SnapshotDependencyTests-1604447549 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.7dcde1fc-aa69-42ca-8a89-08b7419ebdb1 is being set with open permissions: ugo+rw Sep 05 05:17:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b3052d6a-11cd-463d-8679-a716289445b4 tempest-SnapshotDependencyTests-1604447549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.7dcde1fc-aa69-42ca-8a89-08b7419ebdb1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:58 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.7dcde1fc-aa69-42ca-8a89-08b7419ebdb1 Sep 05 05:17:58 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:58 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b3052d6a-11cd-463d-8679-a716289445b4 tempest-SnapshotDependencyTests-1604447549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.7dcde1fc-aa69-42ca-8a89-08b7419ebdb1" returned: 0 in 0.237s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b3052d6a-11cd-463d-8679-a716289445b4 tempest-SnapshotDependencyTests-1604447549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:58 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.info Sep 05 05:17:58 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:58 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b3052d6a-11cd-463d-8679-a716289445b4 tempest-SnapshotDependencyTests-1604447549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.info" returned: 0 in 0.252s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:58 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-b3052d6a-11cd-463d-8679-a716289445b4 tempest-SnapshotDependencyTests-1604447549 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.info is being set with open permissions: ugo+rw Sep 05 05:17:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b3052d6a-11cd-463d-8679-a716289445b4 tempest-SnapshotDependencyTests-1604447549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:17:58 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.info Sep 05 05:17:58 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:17:59 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Sep 05 05:17:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b3052d6a-11cd-463d-8679-a716289445b4 tempest-SnapshotDependencyTests-1604447549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.info" returned: 0 in 0.246s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:17:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b3052d6a-11cd-463d-8679-a716289445b4 tempest-SnapshotDependencyTests-1604447549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.818s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:17:59 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-b3052d6a-11cd-463d-8679-a716289445b4 tempest-SnapshotDependencyTests-1604447549 None] Create snapshot completed successfully Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Flow 'volume_create_manager' (3c106817-e544-41f1-932b-0eba0912a96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bda263-5445-4a7f-a489-461e9507143d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bda263-5445-4a7f-a489-461e9507143d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d14a09-0b73-469c-87fb-e2b3db1d016d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59a197231962420ca6bdd6f85ddcf8a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7dcde1fc-aa69-42ca-8a89-08b7419ebdb1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:18:00Z,use_quota=True,user_id='cb82c28fac4a4161ba5b5440565885ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702ee410-e643-47aa-9fac-a89355f4d4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702ee410-e643-47aa-9fac-a89355f4d4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (573cfe4e-9838-48b5-a305-2f85a1379b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (573cfe4e-9838-48b5-a305-2f85a1379b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c0d14a09-0b73-469c-87fb-e2b3db1d016d', 'volume_name': 'volume-c0d14a09-0b73-469c-87fb-e2b3db1d016d', 'volume_size': 1, 'snapshot_id': '7dcde1fc-aa69-42ca-8a89-08b7419ebdb1'}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1f86fa-4572-48ad-8914-5767952807a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1f86fa-4572-48ad-8914-5767952807a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8fd3333-be4c-4771-84e0-f1e6669c217a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:18:00 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Volume c0d14a09-0b73-469c-87fb-e2b3db1d016d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c0d14a09-0b73-469c-87fb-e2b3db1d016d', 'volume_size': 1, 'snapshot_id': '7dcde1fc-aa69-42ca-8a89-08b7419ebdb1'} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Acquiring lock "cinder-quobyte-7dcde1fc-aa69-42ca-8a89-08b7419ebdb1-c0d14a09-0b73-469c-87fb-e2b3db1d016d" by "_create_volume_from_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-19a67c09-172c-4801-90f4-958ff00da05f req-be103f7c-90b9-4687-a84c-bbe97e83ce93 tempest-TestStampPattern-583355382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Lock "cinder-quobyte-7dcde1fc-aa69-42ca-8a89-08b7419ebdb1-c0d14a09-0b73-469c-87fb-e2b3db1d016d" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Creating volume c0d14a09-0b73-469c-87fb-e2b3db1d016d from snapshot 7dcde1fc-aa69-42ca-8a89-08b7419ebdb1 {{(pid=89331) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Acquiring lock "cinder-quobyte-c0d14a09-0b73-469c-87fb-e2b3db1d016d" by "_copy_volume_from_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Lock "cinder-quobyte-c0d14a09-0b73-469c-87fb-e2b3db1d016d" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] snapshot: 7dcde1fc-aa69-42ca-8a89-08b7419ebdb1, volume: c0d14a09-0b73-469c-87fb-e2b3db1d016d, {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[27103382-0608-45a5-b3b0-ec2243fdb4ca]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.7dcde1fc-aa69-42ca-8a89-08b7419ebdb1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:00 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.7dcde1fc-aa69-42ca-8a89-08b7419ebdb1 Sep 05 05:18:00 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:00 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.7dcde1fc-aa69-42ca-8a89-08b7419ebdb1" returned: 0 in 0.352s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9eab19-ae1a-411d-ae26-df7cd56e8024]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:18:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:00 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f Sep 05 05:18:00 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:01 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f" returned: 0 in 0.375s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 05:18:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Creating direct copy from snapshot {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 05:18:01 devstack cinder-volume[89331]: DEBUG cinder.utils [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Path /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c0d14a09-0b73-469c-87fb-e2b3db1d016d not found in is_blk_device check {{(pid=89331) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 05:18:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c0d14a09-0b73-469c-87fb-e2b3db1d016d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:01 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c0d14a09-0b73-469c-87fb-e2b3db1d016d Sep 05 05:18:01 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:05 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c0d14a09-0b73-469c-87fb-e2b3db1d016d" returned: 0 in 4.173s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:05 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f, size 1024.00 MB, duration 4.17 sec, destination /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c0d14a09-0b73-469c-87fb-e2b3db1d016d {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:18:05 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Converted 1024.00 MB image at 245.33 MB/s Sep 05 05:18:05 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c0d14a09-0b73-469c-87fb-e2b3db1d016d is being set with open permissions: ugo+rw Sep 05 05:18:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c0d14a09-0b73-469c-87fb-e2b3db1d016d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:05 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c0d14a09-0b73-469c-87fb-e2b3db1d016d Sep 05 05:18:05 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:05 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c0d14a09-0b73-469c-87fb-e2b3db1d016d" returned: 0 in 0.253s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Lock "cinder-quobyte-c0d14a09-0b73-469c-87fb-e2b3db1d016d" released by "_copy_volume_from_snapshot" :: held 5.227s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:18:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Lock "cinder-quobyte-7dcde1fc-aa69-42ca-8a89-08b7419ebdb1-c0d14a09-0b73-469c-87fb-e2b3db1d016d" released by "_create_volume_from_snapshot" :: held 5.288s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:18:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.306s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:18:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-19a67c09-172c-4801-90f4-958ff00da05f req-be103f7c-90b9-4687-a84c-bbe97e83ce93 tempest-TestStampPattern-583355382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.298s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:18:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-19a67c09-172c-4801-90f4-958ff00da05f req-be103f7c-90b9-4687-a84c-bbe97e83ce93 tempest-TestStampPattern-583355382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:18:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8fd3333-be4c-4771-84e0-f1e6669c217a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0d14a09-0b73-469c-87fb-e2b3db1d016d', 'volume_size': 1, 'snapshot_id': '7dcde1fc-aa69-42ca-8a89-08b7419ebdb1'}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:18:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385bd7c5-b8c2-4ed7-9078-41117b3ba1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:18:05 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Volume volume-c0d14a09-0b73-469c-87fb-e2b3db1d016d (c0d14a09-0b73-469c-87fb-e2b3db1d016d): created successfully Sep 05 05:18:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385bd7c5-b8c2-4ed7-9078-41117b3ba1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:18:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Flow 'volume_create_manager' (3c106817-e544-41f1-932b-0eba0912a96d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:18:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-19a67c09-172c-4801-90f4-958ff00da05f req-be103f7c-90b9-4687-a84c-bbe97e83ce93 tempest-TestStampPattern-583355382 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136', 'name': 'volume-5484355e-c62a-4831-b28a-e203554f5e57', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75dbcde1-6efb-4136-841f-770e2dc2e43c', 'enforce_multipath': True} {{(pid=89331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 05:18:05 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-b2fd782e-4341-4c62-9c93-44dc9bf669af tempest-SnapshotDependencyTests-1604447549 None] Created volume successfully. Sep 05 05:18:05 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-19a67c09-172c-4801-90f4-958ff00da05f req-be103f7c-90b9-4687-a84c-bbe97e83ce93 tempest-TestStampPattern-583355382 None] attachment_update completed successfully. Sep 05 05:18:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d7f26f60-7ca7-42b4-892d-07ef36f1b78f tempest-SnapshotDependencyTests-1604447549 None] Acquiring lock "cinder-7dcde1fc-aa69-42ca-8a89-08b7419ebdb1-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:18:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d7f26f60-7ca7-42b4-892d-07ef36f1b78f tempest-SnapshotDependencyTests-1604447549 None] Lock "cinder-7dcde1fc-aa69-42ca-8a89-08b7419ebdb1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:18:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d7f26f60-7ca7-42b4-892d-07ef36f1b78f tempest-SnapshotDependencyTests-1604447549 None] Acquiring lock "cinder-quobyte-36ae04ee-6424-4c60-ac7a-9130fa5d886f" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:18:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d7f26f60-7ca7-42b4-892d-07ef36f1b78f tempest-SnapshotDependencyTests-1604447549 None] Lock "cinder-quobyte-36ae04ee-6424-4c60-ac7a-9130fa5d886f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:18:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d7f26f60-7ca7-42b4-892d-07ef36f1b78f tempest-SnapshotDependencyTests-1604447549 None] Acquiring lock "cinder-quobyte-7dcde1fc-aa69-42ca-8a89-08b7419ebdb1" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:18:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d7f26f60-7ca7-42b4-892d-07ef36f1b78f tempest-SnapshotDependencyTests-1604447549 None] Lock "cinder-quobyte-7dcde1fc-aa69-42ca-8a89-08b7419ebdb1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:18:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-d7f26f60-7ca7-42b4-892d-07ef36f1b78f tempest-SnapshotDependencyTests-1604447549 None] Deleting offline snapshot 7dcde1fc-aa69-42ca-8a89-08b7419ebdb1 of volume 36ae04ee-6424-4c60-ac7a-9130fa5d886f {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:18:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-d7f26f60-7ca7-42b4-892d-07ef36f1b78f tempest-SnapshotDependencyTests-1604447549 None] snapshot_file for this snap is: volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.7dcde1fc-aa69-42ca-8a89-08b7419ebdb1 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:18:06 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[16595817-acc8-4d47-aff5-77fb39aea51d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:18:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d7f26f60-7ca7-42b4-892d-07ef36f1b78f tempest-SnapshotDependencyTests-1604447549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.7dcde1fc-aa69-42ca-8a89-08b7419ebdb1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:06 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.7dcde1fc-aa69-42ca-8a89-08b7419ebdb1 Sep 05 05:18:06 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:07 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d7f26f60-7ca7-42b4-892d-07ef36f1b78f tempest-SnapshotDependencyTests-1604447549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.7dcde1fc-aa69-42ca-8a89-08b7419ebdb1" returned: 0 in 0.346s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-d7f26f60-7ca7-42b4-892d-07ef36f1b78f tempest-SnapshotDependencyTests-1604447549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:18:07 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d429dde5-74b1-475d-84e8-43df5a1cb3f4]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:18:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d7f26f60-7ca7-42b4-892d-07ef36f1b78f tempest-SnapshotDependencyTests-1604447549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:07 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f Sep 05 05:18:07 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:07 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d7f26f60-7ca7-42b4-892d-07ef36f1b78f tempest-SnapshotDependencyTests-1604447549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f" returned: 0 in 0.527s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d7f26f60-7ca7-42b4-892d-07ef36f1b78f tempest-SnapshotDependencyTests-1604447549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.7dcde1fc-aa69-42ca-8a89-08b7419ebdb1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:07 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.7dcde1fc-aa69-42ca-8a89-08b7419ebdb1 Sep 05 05:18:07 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:07 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d7f26f60-7ca7-42b4-892d-07ef36f1b78f tempest-SnapshotDependencyTests-1604447549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.7dcde1fc-aa69-42ca-8a89-08b7419ebdb1" returned: 0 in 0.349s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d7f26f60-7ca7-42b4-892d-07ef36f1b78f tempest-SnapshotDependencyTests-1604447549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.7dcde1fc-aa69-42ca-8a89-08b7419ebdb1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:08 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.7dcde1fc-aa69-42ca-8a89-08b7419ebdb1 Sep 05 05:18:08 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:08 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d7f26f60-7ca7-42b4-892d-07ef36f1b78f tempest-SnapshotDependencyTests-1604447549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f.7dcde1fc-aa69-42ca-8a89-08b7419ebdb1" returned: 0 in 0.264s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d7f26f60-7ca7-42b4-892d-07ef36f1b78f tempest-SnapshotDependencyTests-1604447549 None] Lock "cinder-quobyte-7dcde1fc-aa69-42ca-8a89-08b7419ebdb1" released by "_delete_snapshot" :: held 1.580s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:18:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d7f26f60-7ca7-42b4-892d-07ef36f1b78f tempest-SnapshotDependencyTests-1604447549 None] Lock "cinder-quobyte-36ae04ee-6424-4c60-ac7a-9130fa5d886f" released by "delete_snapshot" :: held 1.605s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:18:08 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-d7f26f60-7ca7-42b4-892d-07ef36f1b78f tempest-SnapshotDependencyTests-1604447549 None] Created reservations ['6662800b-e746-4607-ac7c-dda872b485ee', '667fa81b-a395-45b8-99a3-bb059eb12c63', '22e2d2df-9232-4d5f-bda0-fd9a61419dee', '468bdfe0-3191-4bb4-8d03-da3600299aa7'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:18:08 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-d7f26f60-7ca7-42b4-892d-07ef36f1b78f tempest-SnapshotDependencyTests-1604447549 None] Delete snapshot completed successfully. Sep 05 05:18:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d7f26f60-7ca7-42b4-892d-07ef36f1b78f tempest-SnapshotDependencyTests-1604447549 None] Lock "cinder-7dcde1fc-aa69-42ca-8a89-08b7419ebdb1-delete_snapshot" released by "delete_snapshot" :: held 1.746s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:18:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-97bda3cb-251d-4622-8d75-4c41e251691b tempest-SnapshotDependencyTests-1604447549 None] Acquiring lock "cinder-36ae04ee-6424-4c60-ac7a-9130fa5d886f-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:18:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-97bda3cb-251d-4622-8d75-4c41e251691b tempest-SnapshotDependencyTests-1604447549 None] Lock "cinder-36ae04ee-6424-4c60-ac7a-9130fa5d886f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:18:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-97bda3cb-251d-4622-8d75-4c41e251691b tempest-SnapshotDependencyTests-1604447549 None] Acquiring lock "cinder-quobyte-36ae04ee-6424-4c60-ac7a-9130fa5d886f" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:18:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-97bda3cb-251d-4622-8d75-4c41e251691b tempest-SnapshotDependencyTests-1604447549 None] Lock "cinder-quobyte-36ae04ee-6424-4c60-ac7a-9130fa5d886f" acquired by "delete_volume" :: waited 0.026s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:18:08 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a71577-2aac-4c0d-915d-5c02eba87e3e]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:18:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-97bda3cb-251d-4622-8d75-4c41e251691b tempest-SnapshotDependencyTests-1604447549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:09 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f Sep 05 05:18:09 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:09 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-97bda3cb-251d-4622-8d75-4c41e251691b tempest-SnapshotDependencyTests-1604447549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f" returned: 0 in 0.363s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-97bda3cb-251d-4622-8d75-4c41e251691b tempest-SnapshotDependencyTests-1604447549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:09 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f Sep 05 05:18:09 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:09 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-97bda3cb-251d-4622-8d75-4c41e251691b tempest-SnapshotDependencyTests-1604447549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-36ae04ee-6424-4c60-ac7a-9130fa5d886f" returned: 0 in 0.285s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-97bda3cb-251d-4622-8d75-4c41e251691b tempest-SnapshotDependencyTests-1604447549 None] Lock "cinder-quobyte-36ae04ee-6424-4c60-ac7a-9130fa5d886f" released by "delete_volume" :: held 0.706s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:18:09 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-97bda3cb-251d-4622-8d75-4c41e251691b tempest-SnapshotDependencyTests-1604447549 None] Created reservations ['26669ded-37be-4e7f-8e75-c4e3099c204c', '138d5d1c-fe1d-484c-8950-1d694bc7a2f6', 'd2900ebd-d062-46a1-8473-576073894e5e', '7b7570ef-6276-4b37-a6c3-9d79099007a2'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:18:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-97bda3cb-251d-4622-8d75-4c41e251691b tempest-SnapshotDependencyTests-1604447549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:18:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-97bda3cb-251d-4622-8d75-4c41e251691b tempest-SnapshotDependencyTests-1604447549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:18:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-97bda3cb-251d-4622-8d75-4c41e251691b tempest-SnapshotDependencyTests-1604447549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:18:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-97bda3cb-251d-4622-8d75-4c41e251691b tempest-SnapshotDependencyTests-1604447549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:18:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-97bda3cb-251d-4622-8d75-4c41e251691b tempest-SnapshotDependencyTests-1604447549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:18:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-97bda3cb-251d-4622-8d75-4c41e251691b tempest-SnapshotDependencyTests-1604447549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:09 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:18:09 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:09 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-d18cb150-8e71-4b42-9ec3-780b1120568f req-d5815e3f-9b31-4f3c-a554-d21e09dfaea9 tempest-TestStampPattern-583355382 None] Terminate volume connection completed successfully. Sep 05 05:18:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-d18cb150-8e71-4b42-9ec3-780b1120568f req-d5815e3f-9b31-4f3c-a554-d21e09dfaea9 tempest-TestStampPattern-583355382 None] Deleting attachment 75dbcde1-6efb-4136-841f-770e2dc2e43c. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-14112346-f563-40ad-b18b-278b3206b37b tempest-SnapshotDependencyTests-1604447549 None] Acquiring lock "cinder-c0d14a09-0b73-469c-87fb-e2b3db1d016d-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-14112346-f563-40ad-b18b-278b3206b37b tempest-SnapshotDependencyTests-1604447549 None] Lock "cinder-c0d14a09-0b73-469c-87fb-e2b3db1d016d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:18:10 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-97bda3cb-251d-4622-8d75-4c41e251691b tempest-SnapshotDependencyTests-1604447549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.266s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-97bda3cb-251d-4622-8d75-4c41e251691b tempest-SnapshotDependencyTests-1604447549 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:18:10 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-97bda3cb-251d-4622-8d75-4c41e251691b tempest-SnapshotDependencyTests-1604447549 None] Deleted volume successfully. Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-97bda3cb-251d-4622-8d75-4c41e251691b tempest-SnapshotDependencyTests-1604447549 None] Lock "cinder-36ae04ee-6424-4c60-ac7a-9130fa5d886f-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-14112346-f563-40ad-b18b-278b3206b37b tempest-SnapshotDependencyTests-1604447549 None] Acquiring lock "cinder-quobyte-c0d14a09-0b73-469c-87fb-e2b3db1d016d" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-14112346-f563-40ad-b18b-278b3206b37b tempest-SnapshotDependencyTests-1604447549 None] Lock "cinder-quobyte-c0d14a09-0b73-469c-87fb-e2b3db1d016d" acquired by "delete_volume" :: waited 0.014s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc519ea-1957-4e47-ba34-3fcb04f59643]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14112346-f563-40ad-b18b-278b3206b37b tempest-SnapshotDependencyTests-1604447549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c0d14a09-0b73-469c-87fb-e2b3db1d016d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:10 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c0d14a09-0b73-469c-87fb-e2b3db1d016d Sep 05 05:18:10 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:10 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14112346-f563-40ad-b18b-278b3206b37b tempest-SnapshotDependencyTests-1604447549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c0d14a09-0b73-469c-87fb-e2b3db1d016d" returned: 0 in 0.367s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14112346-f563-40ad-b18b-278b3206b37b tempest-SnapshotDependencyTests-1604447549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c0d14a09-0b73-469c-87fb-e2b3db1d016d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:10 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c0d14a09-0b73-469c-87fb-e2b3db1d016d Sep 05 05:18:10 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:10 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14112346-f563-40ad-b18b-278b3206b37b tempest-SnapshotDependencyTests-1604447549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c0d14a09-0b73-469c-87fb-e2b3db1d016d" returned: 0 in 0.267s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-14112346-f563-40ad-b18b-278b3206b37b tempest-SnapshotDependencyTests-1604447549 None] Lock "cinder-quobyte-c0d14a09-0b73-469c-87fb-e2b3db1d016d" released by "delete_volume" :: held 0.692s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-60220398-9ae5-4473-99d2-1d44c604335a tempest-TestStampPattern-583355382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-60220398-9ae5-4473-99d2-1d44c604335a tempest-TestStampPattern-583355382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-60220398-9ae5-4473-99d2-1d44c604335a tempest-TestStampPattern-583355382 None] Creating offline snapshot 739e8da5-1381-4417-be77-d82bd6c6730d of volume 5484355e-c62a-4831-b28a-e203554f5e57 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9cc18c-79e2-4fce-8570-a921688aaea1]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-60220398-9ae5-4473-99d2-1d44c604335a tempest-TestStampPattern-583355382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-14112346-f563-40ad-b18b-278b3206b37b tempest-SnapshotDependencyTests-1604447549 None] Created reservations ['8836c112-3fea-4631-97b0-dff9b1fb5676', '8e163c33-0d5f-4d4e-9eb4-85e89367cf98', '25764d04-3ee4-456e-9191-13e063078b86', '439b0701-13f8-4969-b54f-3b2f86d10035'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-14112346-f563-40ad-b18b-278b3206b37b tempest-SnapshotDependencyTests-1604447549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-14112346-f563-40ad-b18b-278b3206b37b tempest-SnapshotDependencyTests-1604447549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-14112346-f563-40ad-b18b-278b3206b37b tempest-SnapshotDependencyTests-1604447549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-14112346-f563-40ad-b18b-278b3206b37b tempest-SnapshotDependencyTests-1604447549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-14112346-f563-40ad-b18b-278b3206b37b tempest-SnapshotDependencyTests-1604447549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:18:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14112346-f563-40ad-b18b-278b3206b37b tempest-SnapshotDependencyTests-1604447549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:10 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57 Sep 05 05:18:10 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:10 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:18:10 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:11 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14112346-f563-40ad-b18b-278b3206b37b tempest-SnapshotDependencyTests-1604447549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.256s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:11 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-14112346-f563-40ad-b18b-278b3206b37b tempest-SnapshotDependencyTests-1604447549 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:18:11 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-14112346-f563-40ad-b18b-278b3206b37b tempest-SnapshotDependencyTests-1604447549 None] Deleted volume successfully. Sep 05 05:18:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-14112346-f563-40ad-b18b-278b3206b37b tempest-SnapshotDependencyTests-1604447549 None] Lock "cinder-c0d14a09-0b73-469c-87fb-e2b3db1d016d-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:18:11 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-60220398-9ae5-4473-99d2-1d44c604335a tempest-TestStampPattern-583355382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57" returned: 0 in 0.397s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-60220398-9ae5-4473-99d2-1d44c604335a tempest-TestStampPattern-583355382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.739e8da5-1381-4417-be77-d82bd6c6730d 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:11 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.739e8da5-1381-4417-be77-d82bd6c6730d 1G Sep 05 05:18:11 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:11 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-60220398-9ae5-4473-99d2-1d44c604335a tempest-TestStampPattern-583355382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.739e8da5-1381-4417-be77-d82bd6c6730d 1G" returned: 0 in 0.407s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-60220398-9ae5-4473-99d2-1d44c604335a tempest-TestStampPattern-583355382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5484355e-c62a-4831-b28a-e203554f5e57 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.739e8da5-1381-4417-be77-d82bd6c6730d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:11 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5484355e-c62a-4831-b28a-e203554f5e57 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.739e8da5-1381-4417-be77-d82bd6c6730d Sep 05 05:18:11 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:12 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-60220398-9ae5-4473-99d2-1d44c604335a tempest-TestStampPattern-583355382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5484355e-c62a-4831-b28a-e203554f5e57 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.739e8da5-1381-4417-be77-d82bd6c6730d" returned: 0 in 0.345s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:12 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-60220398-9ae5-4473-99d2-1d44c604335a tempest-TestStampPattern-583355382 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.739e8da5-1381-4417-be77-d82bd6c6730d is being set with open permissions: ugo+rw Sep 05 05:18:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-60220398-9ae5-4473-99d2-1d44c604335a tempest-TestStampPattern-583355382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.739e8da5-1381-4417-be77-d82bd6c6730d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:12 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.739e8da5-1381-4417-be77-d82bd6c6730d Sep 05 05:18:12 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:12 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-60220398-9ae5-4473-99d2-1d44c604335a tempest-TestStampPattern-583355382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.739e8da5-1381-4417-be77-d82bd6c6730d" returned: 0 in 0.253s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-60220398-9ae5-4473-99d2-1d44c604335a tempest-TestStampPattern-583355382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:12 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.info Sep 05 05:18:12 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:12 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-60220398-9ae5-4473-99d2-1d44c604335a tempest-TestStampPattern-583355382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.info" returned: 0 in 0.253s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:12 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-60220398-9ae5-4473-99d2-1d44c604335a tempest-TestStampPattern-583355382 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.info is being set with open permissions: ugo+rw Sep 05 05:18:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-60220398-9ae5-4473-99d2-1d44c604335a tempest-TestStampPattern-583355382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:12 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.info Sep 05 05:18:12 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:12 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-60220398-9ae5-4473-99d2-1d44c604335a tempest-TestStampPattern-583355382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.info" returned: 0 in 0.284s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-60220398-9ae5-4473-99d2-1d44c604335a tempest-TestStampPattern-583355382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.032s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:18:12 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-60220398-9ae5-4473-99d2-1d44c604335a tempest-TestStampPattern-583355382 None] Create snapshot completed successfully Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Flow 'volume_create_manager' (f99b5cd1-dfc4-4258-a04a-efe097ae84c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80d62af-9f81-47c2-8351-afb04b7a117b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80d62af-9f81-47c2-8351-afb04b7a117b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-249434061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed2076d-beb2-467f-9ff0-9697cfc54c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530b1fc106cd444ea7f9dc2c186629a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=739e8da5-1381-4417-be77-d82bd6c6730d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:18:21Z,use_quota=True,user_id='2ace3310be344e96add41f77d4f07311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f11cc6-e31d-42e7-87d5-c54b5567a331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f11cc6-e31d-42e7-87d5-c54b5567a331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d846f24-c868-4aca-b145-425f4280baf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d846f24-c868-4aca-b145-425f4280baf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bed2076d-beb2-467f-9ff0-9697cfc54c3b', 'volume_name': 'volume-bed2076d-beb2-467f-9ff0-9697cfc54c3b', 'volume_size': 1, 'snapshot_id': '739e8da5-1381-4417-be77-d82bd6c6730d'}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad844cf0-9a0e-43d4-b10b-fcabeb2ceffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad844cf0-9a0e-43d4-b10b-fcabeb2ceffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690de8cb-53b2-494d-96ea-4ee3004822e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:18:20 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Volume bed2076d-beb2-467f-9ff0-9697cfc54c3b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bed2076d-beb2-467f-9ff0-9697cfc54c3b', 'volume_size': 1, 'snapshot_id': '739e8da5-1381-4417-be77-d82bd6c6730d'} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Acquiring lock "cinder-quobyte-739e8da5-1381-4417-be77-d82bd6c6730d-bed2076d-beb2-467f-9ff0-9697cfc54c3b" by "_create_volume_from_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Lock "cinder-quobyte-739e8da5-1381-4417-be77-d82bd6c6730d-bed2076d-beb2-467f-9ff0-9697cfc54c3b" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Creating volume bed2076d-beb2-467f-9ff0-9697cfc54c3b from snapshot 739e8da5-1381-4417-be77-d82bd6c6730d {{(pid=89331) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Acquiring lock "cinder-quobyte-bed2076d-beb2-467f-9ff0-9697cfc54c3b" by "_copy_volume_from_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Lock "cinder-quobyte-bed2076d-beb2-467f-9ff0-9697cfc54c3b" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] snapshot: 739e8da5-1381-4417-be77-d82bd6c6730d, volume: bed2076d-beb2-467f-9ff0-9697cfc54c3b, {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[723506d4-91e2-4751-9105-b1644265ee80]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:18:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.739e8da5-1381-4417-be77-d82bd6c6730d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:21 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.739e8da5-1381-4417-be77-d82bd6c6730d Sep 05 05:18:21 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:21 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.739e8da5-1381-4417-be77-d82bd6c6730d" returned: 0 in 0.405s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5484355e-c62a-4831-b28a-e203554f5e57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:18:21 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f566b0d-086c-4a5a-9fdd-0c5151139dcf]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:18:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:21 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57 Sep 05 05:18:21 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:21 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57" returned: 0 in 0.397s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57 {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 05:18:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Creating direct copy from snapshot {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 05:18:21 devstack cinder-volume[89331]: DEBUG cinder.utils [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Path /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bed2076d-beb2-467f-9ff0-9697cfc54c3b not found in is_blk_device check {{(pid=89331) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 05:18:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bed2076d-beb2-467f-9ff0-9697cfc54c3b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:21 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bed2076d-beb2-467f-9ff0-9697cfc54c3b Sep 05 05:18:21 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:27 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bed2076d-beb2-467f-9ff0-9697cfc54c3b" returned: 0 in 5.731s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:27 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bed2076d-beb2-467f-9ff0-9697cfc54c3b {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:18:27 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Converted 1024.00 MB image at 178.62 MB/s Sep 05 05:18:27 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bed2076d-beb2-467f-9ff0-9697cfc54c3b is being set with open permissions: ugo+rw Sep 05 05:18:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bed2076d-beb2-467f-9ff0-9697cfc54c3b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:27 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bed2076d-beb2-467f-9ff0-9697cfc54c3b Sep 05 05:18:27 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:27 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bed2076d-beb2-467f-9ff0-9697cfc54c3b" returned: 0 in 0.287s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Lock "cinder-quobyte-bed2076d-beb2-467f-9ff0-9697cfc54c3b" released by "_copy_volume_from_snapshot" :: held 6.920s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:18:27 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Lock "cinder-quobyte-739e8da5-1381-4417-be77-d82bd6c6730d-bed2076d-beb2-467f-9ff0-9697cfc54c3b" released by "_create_volume_from_snapshot" :: held 7.018s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:18:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.038s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:18:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690de8cb-53b2-494d-96ea-4ee3004822e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bed2076d-beb2-467f-9ff0-9697cfc54c3b', 'volume_size': 1, 'snapshot_id': '739e8da5-1381-4417-be77-d82bd6c6730d'}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:18:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf26943-b09c-421b-a060-1483a6b43057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:18:27 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Volume volume-bed2076d-beb2-467f-9ff0-9697cfc54c3b (bed2076d-beb2-467f-9ff0-9697cfc54c3b): created successfully Sep 05 05:18:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf26943-b09c-421b-a060-1483a6b43057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:18:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Flow 'volume_create_manager' (f99b5cd1-dfc4-4258-a04a-efe097ae84c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:18:27 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-e8a4a12b-7538-4bae-bb1f-fcf47dc4d88c tempest-TestStampPattern-583355382 None] Created volume successfully. Sep 05 05:18:37 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:UPDATE=32,cinder:SELECT=41,cinder:INSERT=7,cinder:DELETE=3 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:18:37 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=38,cinder:UPDATE=39,cinder:INSERT=10,cinder:DELETE=4 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:18:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:18:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:18:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:18:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:18:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:18:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:18:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:18:49 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:18:49 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:18:49 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Sep 05 05:18:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.241s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:18:49 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:18:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager._thread_info {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:18:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread count: 29 {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 05:18:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread info: [<_MainThread(MainThread, started 139182109970560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 05:19:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-1b87bd40-3d8a-468a-acbb-19dfc6964ae6 req-ce719670-c42b-4fc1-b0fa-2e5654c35e90 tempest-TestStampPattern-583355382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:19:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-1b87bd40-3d8a-468a-acbb-19dfc6964ae6 req-ce719670-c42b-4fc1-b0fa-2e5654c35e90 tempest-TestStampPattern-583355382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:19:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [req-1b87bd40-3d8a-468a-acbb-19dfc6964ae6 req-ce719670-c42b-4fc1-b0fa-2e5654c35e90 tempest-TestStampPattern-583355382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:19:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-1b87bd40-3d8a-468a-acbb-19dfc6964ae6 req-ce719670-c42b-4fc1-b0fa-2e5654c35e90 tempest-TestStampPattern-583355382 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136', 'name': 'volume-bed2076d-beb2-467f-9ff0-9697cfc54c3b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8db1387f-9cea-4e84-8a55-94ee8f106253', 'enforce_multipath': True} {{(pid=89331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 05:19:10 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-1b87bd40-3d8a-468a-acbb-19dfc6964ae6 req-ce719670-c42b-4fc1-b0fa-2e5654c35e90 tempest-TestStampPattern-583355382 None] attachment_update completed successfully. Sep 05 05:19:12 devstack cinder-volume[89331]: INFO cinder.volume.manager [req-44cf4877-2e5e-4716-bcef-402a62d12efa req-33ad06c7-945a-4506-b2ba-6d7134d82e0e tempest-TestStampPattern-583355382 None] Terminate volume connection completed successfully. Sep 05 05:19:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [req-44cf4877-2e5e-4716-bcef-402a62d12efa req-33ad06c7-945a-4506-b2ba-6d7134d82e0e tempest-TestStampPattern-583355382 None] Deleting attachment 8db1387f-9cea-4e84-8a55-94ee8f106253. {{(pid=89331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 05:19:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ed3e935b-1503-4519-a737-b66043cdd1c4 tempest-TestStampPattern-583355382 None] Acquiring lock "cinder-bed2076d-beb2-467f-9ff0-9697cfc54c3b-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:19:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ed3e935b-1503-4519-a737-b66043cdd1c4 tempest-TestStampPattern-583355382 None] Lock "cinder-bed2076d-beb2-467f-9ff0-9697cfc54c3b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:19:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ed3e935b-1503-4519-a737-b66043cdd1c4 tempest-TestStampPattern-583355382 None] Acquiring lock "cinder-quobyte-bed2076d-beb2-467f-9ff0-9697cfc54c3b" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:19:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ed3e935b-1503-4519-a737-b66043cdd1c4 tempest-TestStampPattern-583355382 None] Lock "cinder-quobyte-bed2076d-beb2-467f-9ff0-9697cfc54c3b" acquired by "delete_volume" :: waited 0.015s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:19:16 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[727d41a3-15bb-4dc6-93cd-ab18c9811966]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:19:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ed3e935b-1503-4519-a737-b66043cdd1c4 tempest-TestStampPattern-583355382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bed2076d-beb2-467f-9ff0-9697cfc54c3b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:17 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bed2076d-beb2-467f-9ff0-9697cfc54c3b Sep 05 05:19:17 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:17 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ed3e935b-1503-4519-a737-b66043cdd1c4 tempest-TestStampPattern-583355382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bed2076d-beb2-467f-9ff0-9697cfc54c3b" returned: 0 in 0.368s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ed3e935b-1503-4519-a737-b66043cdd1c4 tempest-TestStampPattern-583355382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bed2076d-beb2-467f-9ff0-9697cfc54c3b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:17 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bed2076d-beb2-467f-9ff0-9697cfc54c3b Sep 05 05:19:17 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:17 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ed3e935b-1503-4519-a737-b66043cdd1c4 tempest-TestStampPattern-583355382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-bed2076d-beb2-467f-9ff0-9697cfc54c3b" returned: 0 in 0.244s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:17 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ed3e935b-1503-4519-a737-b66043cdd1c4 tempest-TestStampPattern-583355382 None] Lock "cinder-quobyte-bed2076d-beb2-467f-9ff0-9697cfc54c3b" released by "delete_volume" :: held 0.649s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:19:17 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-ed3e935b-1503-4519-a737-b66043cdd1c4 tempest-TestStampPattern-583355382 None] Created reservations ['fcc74af1-7b16-40e8-8211-b1709daf97c5', 'dd5ca86b-2a06-4ed3-85db-0c8d29ac1150', '57b75285-b9b3-4599-8a73-46c8ac24529e', '19f806b3-b5b9-4615-9fe1-06ef9fdfe101'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:19:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ed3e935b-1503-4519-a737-b66043cdd1c4 tempest-TestStampPattern-583355382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:19:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ed3e935b-1503-4519-a737-b66043cdd1c4 tempest-TestStampPattern-583355382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:19:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ed3e935b-1503-4519-a737-b66043cdd1c4 tempest-TestStampPattern-583355382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:19:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ed3e935b-1503-4519-a737-b66043cdd1c4 tempest-TestStampPattern-583355382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:19:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ed3e935b-1503-4519-a737-b66043cdd1c4 tempest-TestStampPattern-583355382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:19:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ed3e935b-1503-4519-a737-b66043cdd1c4 tempest-TestStampPattern-583355382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:17 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:19:17 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:17 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ed3e935b-1503-4519-a737-b66043cdd1c4 tempest-TestStampPattern-583355382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.238s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:17 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-ed3e935b-1503-4519-a737-b66043cdd1c4 tempest-TestStampPattern-583355382 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:19:17 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ed3e935b-1503-4519-a737-b66043cdd1c4 tempest-TestStampPattern-583355382 None] Deleted volume successfully. Sep 05 05:19:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ed3e935b-1503-4519-a737-b66043cdd1c4 tempest-TestStampPattern-583355382 None] Lock "cinder-bed2076d-beb2-467f-9ff0-9697cfc54c3b-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:19:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3614bb05-1ed1-470c-822b-42ebab3c8d30 tempest-TestStampPattern-583355382 None] Acquiring lock "cinder-739e8da5-1381-4417-be77-d82bd6c6730d-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:19:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3614bb05-1ed1-470c-822b-42ebab3c8d30 tempest-TestStampPattern-583355382 None] Lock "cinder-739e8da5-1381-4417-be77-d82bd6c6730d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:19:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3614bb05-1ed1-470c-822b-42ebab3c8d30 tempest-TestStampPattern-583355382 None] Acquiring lock "cinder-quobyte-5484355e-c62a-4831-b28a-e203554f5e57" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:19:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3614bb05-1ed1-470c-822b-42ebab3c8d30 tempest-TestStampPattern-583355382 None] Lock "cinder-quobyte-5484355e-c62a-4831-b28a-e203554f5e57" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:19:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3614bb05-1ed1-470c-822b-42ebab3c8d30 tempest-TestStampPattern-583355382 None] Acquiring lock "cinder-quobyte-739e8da5-1381-4417-be77-d82bd6c6730d" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:19:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3614bb05-1ed1-470c-822b-42ebab3c8d30 tempest-TestStampPattern-583355382 None] Lock "cinder-quobyte-739e8da5-1381-4417-be77-d82bd6c6730d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:19:18 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-3614bb05-1ed1-470c-822b-42ebab3c8d30 tempest-TestStampPattern-583355382 None] Deleting offline snapshot 739e8da5-1381-4417-be77-d82bd6c6730d of volume 5484355e-c62a-4831-b28a-e203554f5e57 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:19:18 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-3614bb05-1ed1-470c-822b-42ebab3c8d30 tempest-TestStampPattern-583355382 None] snapshot_file for this snap is: volume-5484355e-c62a-4831-b28a-e203554f5e57.739e8da5-1381-4417-be77-d82bd6c6730d {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:19:18 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaef63f-94e1-4099-8db1-b0b00630e074]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:19:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3614bb05-1ed1-470c-822b-42ebab3c8d30 tempest-TestStampPattern-583355382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.739e8da5-1381-4417-be77-d82bd6c6730d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:18 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.739e8da5-1381-4417-be77-d82bd6c6730d Sep 05 05:19:18 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:18 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3614bb05-1ed1-470c-822b-42ebab3c8d30 tempest-TestStampPattern-583355382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.739e8da5-1381-4417-be77-d82bd6c6730d" returned: 0 in 0.352s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:18 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-3614bb05-1ed1-470c-822b-42ebab3c8d30 tempest-TestStampPattern-583355382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5484355e-c62a-4831-b28a-e203554f5e57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:19:18 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc25588b-8406-4225-89be-c4e5e5ab830a]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:19:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3614bb05-1ed1-470c-822b-42ebab3c8d30 tempest-TestStampPattern-583355382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:18 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57 Sep 05 05:19:18 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:19 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3614bb05-1ed1-470c-822b-42ebab3c8d30 tempest-TestStampPattern-583355382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57" returned: 0 in 0.510s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3614bb05-1ed1-470c-822b-42ebab3c8d30 tempest-TestStampPattern-583355382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.739e8da5-1381-4417-be77-d82bd6c6730d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:19 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.739e8da5-1381-4417-be77-d82bd6c6730d Sep 05 05:19:19 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:19 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3614bb05-1ed1-470c-822b-42ebab3c8d30 tempest-TestStampPattern-583355382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.739e8da5-1381-4417-be77-d82bd6c6730d" returned: 0 in 0.314s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3614bb05-1ed1-470c-822b-42ebab3c8d30 tempest-TestStampPattern-583355382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.739e8da5-1381-4417-be77-d82bd6c6730d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:19 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.739e8da5-1381-4417-be77-d82bd6c6730d Sep 05 05:19:19 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:19 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3614bb05-1ed1-470c-822b-42ebab3c8d30 tempest-TestStampPattern-583355382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57.739e8da5-1381-4417-be77-d82bd6c6730d" returned: 0 in 0.240s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:19 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3614bb05-1ed1-470c-822b-42ebab3c8d30 tempest-TestStampPattern-583355382 None] Lock "cinder-quobyte-739e8da5-1381-4417-be77-d82bd6c6730d" released by "_delete_snapshot" :: held 1.510s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:19:19 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3614bb05-1ed1-470c-822b-42ebab3c8d30 tempest-TestStampPattern-583355382 None] Lock "cinder-quobyte-5484355e-c62a-4831-b28a-e203554f5e57" released by "delete_snapshot" :: held 1.531s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:19:19 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-3614bb05-1ed1-470c-822b-42ebab3c8d30 tempest-TestStampPattern-583355382 None] Created reservations ['5e648b7d-dec3-4f06-bad6-66085a6cdde0', '49a0ab4b-0e81-484b-9094-c5b5c4a82039', '21df8252-d02b-4fd5-a6ce-393c5d2bfe3b', 'f0c9214d-c9be-4e41-9f83-03e234d85bf7'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:19:19 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-3614bb05-1ed1-470c-822b-42ebab3c8d30 tempest-TestStampPattern-583355382 None] Delete snapshot completed successfully. Sep 05 05:19:19 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3614bb05-1ed1-470c-822b-42ebab3c8d30 tempest-TestStampPattern-583355382 None] Lock "cinder-739e8da5-1381-4417-be77-d82bd6c6730d-delete_snapshot" released by "delete_snapshot" :: held 1.655s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:19:23 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a9e67b20-3122-4361-a809-1a0e1bd59c01 tempest-TestStampPattern-583355382 None] Acquiring lock "cinder-5484355e-c62a-4831-b28a-e203554f5e57-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:19:23 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a9e67b20-3122-4361-a809-1a0e1bd59c01 tempest-TestStampPattern-583355382 None] Lock "cinder-5484355e-c62a-4831-b28a-e203554f5e57-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:19:23 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a9e67b20-3122-4361-a809-1a0e1bd59c01 tempest-TestStampPattern-583355382 None] Acquiring lock "cinder-quobyte-5484355e-c62a-4831-b28a-e203554f5e57" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:19:23 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a9e67b20-3122-4361-a809-1a0e1bd59c01 tempest-TestStampPattern-583355382 None] Lock "cinder-quobyte-5484355e-c62a-4831-b28a-e203554f5e57" acquired by "delete_volume" :: waited 0.016s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:19:23 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[3964cf19-8eb3-45cb-8666-771f6e4f9366]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:19:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a9e67b20-3122-4361-a809-1a0e1bd59c01 tempest-TestStampPattern-583355382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:24 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57 Sep 05 05:19:24 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:24 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a9e67b20-3122-4361-a809-1a0e1bd59c01 tempest-TestStampPattern-583355382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57" returned: 0 in 0.353s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a9e67b20-3122-4361-a809-1a0e1bd59c01 tempest-TestStampPattern-583355382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:24 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57 Sep 05 05:19:24 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:24 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a9e67b20-3122-4361-a809-1a0e1bd59c01 tempest-TestStampPattern-583355382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-5484355e-c62a-4831-b28a-e203554f5e57" returned: 0 in 0.243s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:24 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a9e67b20-3122-4361-a809-1a0e1bd59c01 tempest-TestStampPattern-583355382 None] Lock "cinder-quobyte-5484355e-c62a-4831-b28a-e203554f5e57" released by "delete_volume" :: held 0.652s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:19:24 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-a9e67b20-3122-4361-a809-1a0e1bd59c01 tempest-TestStampPattern-583355382 None] Created reservations ['65616bab-c47d-4859-ae49-938b5398e20e', 'bc39a8cb-ab65-4d23-8dce-140bb5573ce0', 'e74dfe46-f530-4d8c-99b5-3d19ac5c875c', 'e8619ef3-b8c1-4e99-9e12-9375a426d647'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:19:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a9e67b20-3122-4361-a809-1a0e1bd59c01 tempest-TestStampPattern-583355382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:19:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a9e67b20-3122-4361-a809-1a0e1bd59c01 tempest-TestStampPattern-583355382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:19:24 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a9e67b20-3122-4361-a809-1a0e1bd59c01 tempest-TestStampPattern-583355382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:19:24 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a9e67b20-3122-4361-a809-1a0e1bd59c01 tempest-TestStampPattern-583355382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:19:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a9e67b20-3122-4361-a809-1a0e1bd59c01 tempest-TestStampPattern-583355382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:19:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a9e67b20-3122-4361-a809-1a0e1bd59c01 tempest-TestStampPattern-583355382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:24 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:19:24 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:24 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a9e67b20-3122-4361-a809-1a0e1bd59c01 tempest-TestStampPattern-583355382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.238s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:24 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-a9e67b20-3122-4361-a809-1a0e1bd59c01 tempest-TestStampPattern-583355382 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:19:24 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-a9e67b20-3122-4361-a809-1a0e1bd59c01 tempest-TestStampPattern-583355382 None] Deleted volume successfully. Sep 05 05:19:24 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-a9e67b20-3122-4361-a809-1a0e1bd59c01 tempest-TestStampPattern-583355382 None] Lock "cinder-5484355e-c62a-4831-b28a-e203554f5e57-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:19:34 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=21,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=1 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:19:34 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=25,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:19:39 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:19:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Flow 'volume_create_manager' (95973680-75b8-4704-bae5-a4f09ea42ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:19:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65809eff-9e73-4750-8309-ec161d66d805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:19:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65809eff-9e73-4750-8309-ec161d66d805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fdaac87-bdf9-417f-831b-42c294fefdad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ece7d2a5bf490db9840bb510f64a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:19:39Z,use_quota=True,user_id='7acafb03a47a4ebf9015890b9f6d5f12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb4df4fe-2d6f-49fe-b945-0cac63e4cb27),volume_type_id=eb4df4fe-2d6f-49fe-b945-0cac63e4cb27)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:19:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9511c66-b8cc-4997-8581-2495721451ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:19:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9511c66-b8cc-4997-8581-2495721451ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:19:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c991f6-42d3-4fa7-9680-6961cc0f3dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:19:39 devstack cinder-volume[89331]: DEBUG cinder.image.glance [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Creating Keystone auth plugin from conf {{(pid=89331) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 05:19:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c991f6-42d3-4fa7-9680-6961cc0f3dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6fdaac87-bdf9-417f-831b-42c294fefdad', 'volume_name': 'volume-6fdaac87-bdf9-417f-831b-42c294fefdad', 'volume_size': 1, 'image_id': '3be2382d-62e2-489d-b5e4-4ac58cc6c3c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3be2382d-62e2-489d-b5e4-4ac58cc6c3c6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e3f5cbe24645642fd371aa28cea7928d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '72ece7d2a5bf490db9840bb510f64a59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e3421d5e59fbef67d65401324418f77248c966f0f44db4f9c8ae5cba92c583601abacc08b27846f865eaf77c1bd60e9e70aa878983f668ed1c3e4697ab99d0b4', 'id': '3be2382d-62e2-489d-b5e4-4ac58cc6c3c6', 'created_at': datetime.datetime(2026, 9, 5, 3, 19, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 3, 19, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3be2382d-62e2-489d-b5e4-4ac58cc6c3c6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:19:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4576ad5b-0e96-4498-80d8-bb77b8f918ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:19:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4576ad5b-0e96-4498-80d8-bb77b8f918ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:19:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2244a9-8223-4f08-bb99-4885d68f6130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:19:39 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Volume 6fdaac87-bdf9-417f-831b-42c294fefdad: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6fdaac87-bdf9-417f-831b-42c294fefdad', 'volume_size': 1, 'image_id': '3be2382d-62e2-489d-b5e4-4ac58cc6c3c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3be2382d-62e2-489d-b5e4-4ac58cc6c3c6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e3f5cbe24645642fd371aa28cea7928d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '72ece7d2a5bf490db9840bb510f64a59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e3421d5e59fbef67d65401324418f77248c966f0f44db4f9c8ae5cba92c583601abacc08b27846f865eaf77c1bd60e9e70aa878983f668ed1c3e4697ab99d0b4', 'id': '3be2382d-62e2-489d-b5e4-4ac58cc6c3c6', 'created_at': datetime.datetime(2026, 9, 5, 3, 19, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 3, 19, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3be2382d-62e2-489d-b5e4-4ac58cc6c3c6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 05 05:19:39 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Trying to clone 6fdaac87-bdf9-417f-831b-42c294fefdad from image 3be2382d-62e2-489d-b5e4-4ac58cc6c3c6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3be2382d-62e2-489d-b5e4-4ac58cc6c3c6', 'metadata': {}}]). {{(pid=89331) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 05:19:39 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 05:19:39 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Image download 0.00 MB at 0.00 MB/s Sep 05 05:19:39 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6995c9be-7adf-4497-aae6-2b1c84c10721]: (4, 'raw') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:19:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:39 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD Sep 05 05:19:39 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:39 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD" returned: 0 in 0.322s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:40 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD Sep 05 05:19:40 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:40 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD" returned: 1 in 0.326s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD' failed. Not Retrying. {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 05:19:40 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Temporary image 3be2382d-62e2-489d-b5e4-4ac58cc6c3c6 is fetched for user 7acafb03a47a4ebf9015890b9f6d5f12. {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 05:19:40 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f4b2b4-6a9c-4de5-bc13-324808d45a8f]: (4, 'raw') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:19:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:40 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD Sep 05 05:19:40 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:40 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD" returned: 0 in 0.316s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:40 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD Sep 05 05:19:40 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:40 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD" returned: 1 in 0.323s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD' failed. Not Retrying. {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 05:19:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:19:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:19:40 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fdaac87-bdf9-417f-831b-42c294fefdad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ece7d2a5bf490db9840bb510f64a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:19:39Z,use_quota=True,user_id='7acafb03a47a4ebf9015890b9f6d5f12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb4df4fe-2d6f-49fe-b945-0cac63e4cb27),volume_type_id=eb4df4fe-2d6f-49fe-b945-0cac63e4cb27)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:19:40 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Creating volume 6fdaac87-bdf9-417f-831b-42c294fefdad {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:19:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:19:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:19:40 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:19:40 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:19:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:19:40 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:19:40 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:19:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6fdaac87-bdf9-417f-831b-42c294fefdad 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:41 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6fdaac87-bdf9-417f-831b-42c294fefdad 1073741824 Sep 05 05:19:41 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:41 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6fdaac87-bdf9-417f-831b-42c294fefdad 1073741824" returned: 0 in 0.407s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6fdaac87-bdf9-417f-831b-42c294fefdad {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:41 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6fdaac87-bdf9-417f-831b-42c294fefdad Sep 05 05:19:41 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:41 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6fdaac87-bdf9-417f-831b-42c294fefdad" returned: 0 in 0.240s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:41 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:19:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:19:41 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Attempting download of 3be2382d-62e2-489d-b5e4-4ac58cc6c3c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/3be2382d-62e2-489d-b5e4-4ac58cc6c3c6', 'metadata': {}}])) to volume 6fdaac87-bdf9-417f-831b-42c294fefdad. {{(pid=89331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 05:19:41 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f866a4e-e7b6-4e2b-99c0-924a23e4b75c]: (4, 'raw') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:19:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_aeycn4pv {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:41 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_aeycn4pv Sep 05 05:19:41 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:42 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_aeycn4pv" returned: 0 in 0.327s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_aeycn4pv {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:42 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_aeycn4pv Sep 05 05:19:42 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:42 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_aeycn4pv" returned: 1 in 0.320s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_aeycn4pv' failed. Not Retrying. {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 05:19:42 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[241b0796-8a84-41ff-b25c-2f7818fd5191]: (4, 'raw') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:19:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:42 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD Sep 05 05:19:42 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:42 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD" returned: 0 in 0.321s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:42 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD Sep 05 05:19:42 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:43 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD" returned: 1 in 0.324s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD' failed. Not Retrying. {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 05:19:43 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] 3be2382d-62e2-489d-b5e4-4ac58cc6c3c6 was raw, converting to qcow2 {{(pid=89331) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 05:19:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6fdaac87-bdf9-417f-831b-42c294fefdad {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:43 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6fdaac87-bdf9-417f-831b-42c294fefdad Sep 05 05:19:43 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:43 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6fdaac87-bdf9-417f-831b-42c294fefdad" returned: 0 in 0.429s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:43 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3be2382d-62e2-489d-b5e4-4ac58cc6c3c6_a_x2bug0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6fdaac87-bdf9-417f-831b-42c294fefdad {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:19:43 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Converted 0.00 MB image at 0.00 MB/s Sep 05 05:19:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6fdaac87-bdf9-417f-831b-42c294fefdad 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:43 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6fdaac87-bdf9-417f-831b-42c294fefdad 1G Sep 05 05:19:43 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:43 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6fdaac87-bdf9-417f-831b-42c294fefdad 1G" returned: 0 in 0.295s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:43 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Downloaded image 3be2382d-62e2-489d-b5e4-4ac58cc6c3c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/3be2382d-62e2-489d-b5e4-4ac58cc6c3c6', 'metadata': {}}])) to volume 6fdaac87-bdf9-417f-831b-42c294fefdad successfully. {{(pid=89331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 05:19:43 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Temporary image 3be2382d-62e2-489d-b5e4-4ac58cc6c3c6 for user 7acafb03a47a4ebf9015890b9f6d5f12 is deleted. {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 05:19:43 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Marking volume 6fdaac87-bdf9-417f-831b-42c294fefdad as bootable. {{(pid=89331) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 05:19:43 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Copying metadata from image 3be2382d-62e2-489d-b5e4-4ac58cc6c3c6 to 6fdaac87-bdf9-417f-831b-42c294fefdad. {{(pid=89331) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 05:19:43 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Creating volume glance metadata for volume 6fdaac87-bdf9-417f-831b-42c294fefdad backed by image 3be2382d-62e2-489d-b5e4-4ac58cc6c3c6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3be2382d-62e2-489d-b5e4-4ac58cc6c3c6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e3f5cbe24645642fd371aa28cea7928d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89331) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 05:19:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2244a9-8223-4f08-bb99-4885d68f6130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fdaac87-bdf9-417f-831b-42c294fefdad', 'volume_size': 1, 'image_id': '3be2382d-62e2-489d-b5e4-4ac58cc6c3c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3be2382d-62e2-489d-b5e4-4ac58cc6c3c6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e3f5cbe24645642fd371aa28cea7928d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '72ece7d2a5bf490db9840bb510f64a59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e3421d5e59fbef67d65401324418f77248c966f0f44db4f9c8ae5cba92c583601abacc08b27846f865eaf77c1bd60e9e70aa878983f668ed1c3e4697ab99d0b4', 'id': '3be2382d-62e2-489d-b5e4-4ac58cc6c3c6', 'created_at': datetime.datetime(2026, 9, 5, 3, 19, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 3, 19, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3be2382d-62e2-489d-b5e4-4ac58cc6c3c6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:19:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0303fe1-32eb-4ee7-8051-7625fab58fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:19:43 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Volume volume-6fdaac87-bdf9-417f-831b-42c294fefdad (6fdaac87-bdf9-417f-831b-42c294fefdad): created successfully Sep 05 05:19:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0303fe1-32eb-4ee7-8051-7625fab58fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:19:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Flow 'volume_create_manager' (95973680-75b8-4704-bae5-a4f09ea42ada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:19:43 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-c13b5893-0b1f-4f82-8983-08737e0a72c7 tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Created volume successfully. Sep 05 05:19:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e584e754-c67c-4f36-b0a6-aa4fbac033fb tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Acquiring lock "cinder-6fdaac87-bdf9-417f-831b-42c294fefdad-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:19:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e584e754-c67c-4f36-b0a6-aa4fbac033fb tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Lock "cinder-6fdaac87-bdf9-417f-831b-42c294fefdad-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:19:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e584e754-c67c-4f36-b0a6-aa4fbac033fb tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Acquiring lock "cinder-quobyte-6fdaac87-bdf9-417f-831b-42c294fefdad" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:19:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e584e754-c67c-4f36-b0a6-aa4fbac033fb tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Lock "cinder-quobyte-6fdaac87-bdf9-417f-831b-42c294fefdad" acquired by "delete_volume" :: waited 0.013s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:19:44 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7aaf0d5-6413-4ba5-ac8a-a38a28a392b8]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:19:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e584e754-c67c-4f36-b0a6-aa4fbac033fb tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6fdaac87-bdf9-417f-831b-42c294fefdad {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:44 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6fdaac87-bdf9-417f-831b-42c294fefdad Sep 05 05:19:44 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:44 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e584e754-c67c-4f36-b0a6-aa4fbac033fb tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6fdaac87-bdf9-417f-831b-42c294fefdad" returned: 0 in 0.354s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e584e754-c67c-4f36-b0a6-aa4fbac033fb tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6fdaac87-bdf9-417f-831b-42c294fefdad {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:44 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6fdaac87-bdf9-417f-831b-42c294fefdad Sep 05 05:19:44 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:45 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e584e754-c67c-4f36-b0a6-aa4fbac033fb tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6fdaac87-bdf9-417f-831b-42c294fefdad" returned: 0 in 0.248s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:45 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e584e754-c67c-4f36-b0a6-aa4fbac033fb tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Lock "cinder-quobyte-6fdaac87-bdf9-417f-831b-42c294fefdad" released by "delete_volume" :: held 0.639s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:19:45 devstack cinder-volume[89331]: WARNING cinder.quota [None req-e584e754-c67c-4f36-b0a6-aa4fbac033fb tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:19:45 devstack cinder-volume[89331]: WARNING cinder.quota [None req-e584e754-c67c-4f36-b0a6-aa4fbac033fb tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 05 05:19:45 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-e584e754-c67c-4f36-b0a6-aa4fbac033fb tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Created reservations ['e62906a7-fb8f-4145-ba89-5d7e4480f8db', '8d36eea6-4a35-4566-b73b-5ca9cf6e754c', '01292b84-f5b9-45df-89ca-ea97fecab2ba', '7d02716b-ed7a-42a9-bb98-8786f8d84905'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:19:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e584e754-c67c-4f36-b0a6-aa4fbac033fb tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:19:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e584e754-c67c-4f36-b0a6-aa4fbac033fb tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:19:45 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e584e754-c67c-4f36-b0a6-aa4fbac033fb tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:19:45 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e584e754-c67c-4f36-b0a6-aa4fbac033fb tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:19:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e584e754-c67c-4f36-b0a6-aa4fbac033fb tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:19:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e584e754-c67c-4f36-b0a6-aa4fbac033fb tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:45 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:19:45 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:45 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e584e754-c67c-4f36-b0a6-aa4fbac033fb tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.244s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:45 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-e584e754-c67c-4f36-b0a6-aa4fbac033fb tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:19:45 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-e584e754-c67c-4f36-b0a6-aa4fbac033fb tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Deleted volume successfully. Sep 05 05:19:45 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e584e754-c67c-4f36-b0a6-aa4fbac033fb tempest-VolumeAndVolumeTypeFromImageTest-1894696965 None] Lock "cinder-6fdaac87-bdf9-417f-831b-42c294fefdad-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:19:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:19:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:19:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:19:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:19:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:19:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:19:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:19:49 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:19:49 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:19:49 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Sep 05 05:19:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.245s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:19:49 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:19:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager._thread_info {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:19:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread count: 29 {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 05:19:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread info: [<_MainThread(MainThread, started 139182109970560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 05:19:55 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=14,cinder:INSERT=8,cinder:UPDATE=13 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:19:55 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:UPDATE=12,cinder:SELECT=12,cinder:INSERT=7,cinder:DELETE=2 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:20:02 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Flow 'volume_create_manager' (7fedabe2-e4d7-4112-b6ab-35328ebc685c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0bc8818-ed1c-44ca-9ffe-4b959935afc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0bc8818-ed1c-44ca-9ffe-4b959935afc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-517166623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d97ebd-7523-4d5e-b72e-a501b9e8a224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6b104c60dc47af86fa1a8a6f815e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:03Z,use_quota=True,user_id='1e975816f90b4e9bbc2b65e0da56c74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d772b5f4-d4f2-4fe1-937b-7f22cdb3dcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d772b5f4-d4f2-4fe1-937b-7f22cdb3dcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac734f54-70fa-48df-b701-201a735bbf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac734f54-70fa-48df-b701-201a735bbf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23d97ebd-7523-4d5e-b72e-a501b9e8a224', 'volume_name': 'volume-23d97ebd-7523-4d5e-b72e-a501b9e8a224', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26058f07-3ae0-439d-9c72-b4c153ca6768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26058f07-3ae0-439d-9c72-b4c153ca6768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:02 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043a6530-1e1f-42d6-9bfb-5194dc4ed2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:02 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Volume 23d97ebd-7523-4d5e-b72e-a501b9e8a224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23d97ebd-7523-4d5e-b72e-a501b9e8a224', 'volume_size': 1} Sep 05 05:20:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-517166623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d97ebd-7523-4d5e-b72e-a501b9e8a224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6b104c60dc47af86fa1a8a6f815e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:03Z,use_quota=True,user_id='1e975816f90b4e9bbc2b65e0da56c74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Creating volume 23d97ebd-7523-4d5e-b72e-a501b9e8a224 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:02 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23d97ebd-7523-4d5e-b72e-a501b9e8a224 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:02 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23d97ebd-7523-4d5e-b72e-a501b9e8a224 1073741824 Sep 05 05:20:02 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:03 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23d97ebd-7523-4d5e-b72e-a501b9e8a224 1073741824" returned: 0 in 0.669s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Flow 'volume_create_manager' (9fa67d19-1f76-4782-90c3-ab79db41f8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b51b95-63cb-484a-bf31-2c25f106263c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b51b95-63cb-484a-bf31-2c25f106263c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-537409527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68513e1b-41c6-4279-832e-99eefaae06fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6b104c60dc47af86fa1a8a6f815e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:03Z,use_quota=True,user_id='1e975816f90b4e9bbc2b65e0da56c74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c23101e6-985a-4dcf-858b-273447e67ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c23101e6-985a-4dcf-858b-273447e67ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71d701c-8917-48de-a43b-5fc6417a9a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71d701c-8917-48de-a43b-5fc6417a9a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68513e1b-41c6-4279-832e-99eefaae06fd', 'volume_name': 'volume-68513e1b-41c6-4279-832e-99eefaae06fd', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef39f75-99b5-4407-a414-9fdd426e4143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef39f75-99b5-4407-a414-9fdd426e4143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d9c935-4ec8-4acc-8d37-ae78838d8ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:03 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Volume 68513e1b-41c6-4279-832e-99eefaae06fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68513e1b-41c6-4279-832e-99eefaae06fd', 'volume_size': 1} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23d97ebd-7523-4d5e-b72e-a501b9e8a224 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:03 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23d97ebd-7523-4d5e-b72e-a501b9e8a224 Sep 05 05:20:03 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Flow 'volume_create_manager' (727fdc3b-cbf0-40ba-b239-87267333bf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47820336-59fd-43e5-88c2-b99bc9271f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47820336-59fd-43e5-88c2-b99bc9271f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1786798766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57732daf-50fc-4db0-b611-145bf607224a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6b104c60dc47af86fa1a8a6f815e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:04Z,use_quota=True,user_id='1e975816f90b4e9bbc2b65e0da56c74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c0ae5f-c59a-438b-8fa1-c0b2efbcce31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c0ae5f-c59a-438b-8fa1-c0b2efbcce31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13e31c1-e808-4e72-a291-27d30de30bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13e31c1-e808-4e72-a291-27d30de30bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57732daf-50fc-4db0-b611-145bf607224a', 'volume_name': 'volume-57732daf-50fc-4db0-b611-145bf607224a', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f7f8b8-42fa-4fe5-aa66-19f11f3be5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f7f8b8-42fa-4fe5-aa66-19f11f3be5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546afd5b-9d30-470c-9f9f-5ffe272efee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:03 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Volume 57732daf-50fc-4db0-b611-145bf607224a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57732daf-50fc-4db0-b611-145bf607224a', 'volume_size': 1} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:03 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23d97ebd-7523-4d5e-b72e-a501b9e8a224" returned: 0 in 0.308s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.330s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:03 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-537409527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68513e1b-41c6-4279-832e-99eefaae06fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6b104c60dc47af86fa1a8a6f815e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:03Z,use_quota=True,user_id='1e975816f90b4e9bbc2b65e0da56c74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Creating volume 68513e1b-41c6-4279-832e-99eefaae06fd {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:04 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-68513e1b-41c6-4279-832e-99eefaae06fd 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043a6530-1e1f-42d6-9bfb-5194dc4ed2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23d97ebd-7523-4d5e-b72e-a501b9e8a224', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67d0dc77-044b-43e9-9eae-936a8074c6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:04 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Volume volume-23d97ebd-7523-4d5e-b72e-a501b9e8a224 (23d97ebd-7523-4d5e-b72e-a501b9e8a224): created successfully Sep 05 05:20:04 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-68513e1b-41c6-4279-832e-99eefaae06fd 1073741824 Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67d0dc77-044b-43e9-9eae-936a8074c6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:04 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Flow 'volume_create_manager' (7fedabe2-e4d7-4112-b6ab-35328ebc685c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:04 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-5cd28d9c-7f2d-46e9-91a6-7c53a5b97377 tempest-CreateVolumesFromImageTest-1075786189 None] Created volume successfully. Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Flow 'volume_create_manager' (57c3f156-e09f-4a70-8366-c7d4d9efb805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1da3f27-993a-4036-8d21-7721fd5362d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1da3f27-993a-4036-8d21-7721fd5362d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1854320531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcab517d-bf4d-4f25-9a3c-11a8ebce8896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6b104c60dc47af86fa1a8a6f815e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:04Z,use_quota=True,user_id='1e975816f90b4e9bbc2b65e0da56c74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06c655f-e27a-4b96-926e-eece9793a0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06c655f-e27a-4b96-926e-eece9793a0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d56deb-6607-4062-b3db-360740f02e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d56deb-6607-4062-b3db-360740f02e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcab517d-bf4d-4f25-9a3c-11a8ebce8896', 'volume_name': 'volume-dcab517d-bf4d-4f25-9a3c-11a8ebce8896', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:04 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be56aa44-3ba2-4fa8-af72-7f25173c3655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be56aa44-3ba2-4fa8-af72-7f25173c3655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48321f66-92fc-47b1-b0f7-b97ffafc9871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:04 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Volume dcab517d-bf4d-4f25-9a3c-11a8ebce8896: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcab517d-bf4d-4f25-9a3c-11a8ebce8896', 'volume_size': 1} Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-68513e1b-41c6-4279-832e-99eefaae06fd 1073741824" returned: 0 in 0.660s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-68513e1b-41c6-4279-832e-99eefaae06fd {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:04 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-68513e1b-41c6-4279-832e-99eefaae06fd Sep 05 05:20:04 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:05 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Flow 'volume_create_manager' (b8a7b428-960b-4f14-a68c-d66d9636619c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbe9c56-c63f-4469-9438-fddd7005302e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-68513e1b-41c6-4279-832e-99eefaae06fd" returned: 0 in 0.372s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.151s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1786798766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57732daf-50fc-4db0-b611-145bf607224a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6b104c60dc47af86fa1a8a6f815e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:04Z,use_quota=True,user_id='1e975816f90b4e9bbc2b65e0da56c74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Creating volume 57732daf-50fc-4db0-b611-145bf607224a {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:05 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57732daf-50fc-4db0-b611-145bf607224a 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbe9c56-c63f-4469-9438-fddd7005302e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1914215890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdaa67ad-2820-457b-8893-3ec04aa57fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6b104c60dc47af86fa1a8a6f815e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:05Z,use_quota=True,user_id='1e975816f90b4e9bbc2b65e0da56c74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:05 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57732daf-50fc-4db0-b611-145bf607224a 1073741824 Sep 05 05:20:05 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bd6cb1-c5bd-474c-b7e3-733ccfdd5a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bd6cb1-c5bd-474c-b7e3-733ccfdd5a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3cf50eb-165a-4b03-b9ec-ba5053a019d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3cf50eb-165a-4b03-b9ec-ba5053a019d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdaa67ad-2820-457b-8893-3ec04aa57fd7', 'volume_name': 'volume-cdaa67ad-2820-457b-8893-3ec04aa57fd7', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a40f19b7-0fe8-4e01-a7ad-64033454c9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a40f19b7-0fe8-4e01-a7ad-64033454c9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a77dcba5-cd63-4ab9-a50b-9b8cb0729199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:05 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Volume cdaa67ad-2820-457b-8893-3ec04aa57fd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdaa67ad-2820-457b-8893-3ec04aa57fd7', 'volume_size': 1} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d9c935-4ec8-4acc-8d37-ae78838d8ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68513e1b-41c6-4279-832e-99eefaae06fd', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b7480a-48b1-4ae4-a2e7-68657a23e4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:05 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Volume volume-68513e1b-41c6-4279-832e-99eefaae06fd (68513e1b-41c6-4279-832e-99eefaae06fd): created successfully Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b7480a-48b1-4ae4-a2e7-68657a23e4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Flow 'volume_create_manager' (9fa67d19-1f76-4782-90c3-ab79db41f8d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:05 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-75037cb8-c494-45f2-8b9e-42f1423d9b46 tempest-CreateVolumesFromImageTest-1075786189 None] Created volume successfully. Sep 05 05:20:05 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57732daf-50fc-4db0-b611-145bf607224a 1073741824" returned: 0 in 0.539s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57732daf-50fc-4db0-b611-145bf607224a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:05 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57732daf-50fc-4db0-b611-145bf607224a Sep 05 05:20:05 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:05 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57732daf-50fc-4db0-b611-145bf607224a" returned: 0 in 0.299s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.310s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1854320531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcab517d-bf4d-4f25-9a3c-11a8ebce8896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6b104c60dc47af86fa1a8a6f815e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:04Z,use_quota=True,user_id='1e975816f90b4e9bbc2b65e0da56c74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Creating volume dcab517d-bf4d-4f25-9a3c-11a8ebce8896 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:05 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-dcab517d-bf4d-4f25-9a3c-11a8ebce8896 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:06 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-dcab517d-bf4d-4f25-9a3c-11a8ebce8896 1073741824 Sep 05 05:20:06 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546afd5b-9d30-470c-9f9f-5ffe272efee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57732daf-50fc-4db0-b611-145bf607224a', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d3caf7-663b-49c8-b1ee-7cfeb114abb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:06 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Volume volume-57732daf-50fc-4db0-b611-145bf607224a (57732daf-50fc-4db0-b611-145bf607224a): created successfully Sep 05 05:20:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d3caf7-663b-49c8-b1ee-7cfeb114abb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Flow 'volume_create_manager' (727fdc3b-cbf0-40ba-b239-87267333bf37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:06 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-54f13669-13bf-4f8b-a03c-72859d9c2e53 tempest-CreateVolumesFromImageTest-1075786189 None] Created volume successfully. Sep 05 05:20:06 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-dcab517d-bf4d-4f25-9a3c-11a8ebce8896 1073741824" returned: 0 in 0.484s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-dcab517d-bf4d-4f25-9a3c-11a8ebce8896 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:06 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-dcab517d-bf4d-4f25-9a3c-11a8ebce8896 Sep 05 05:20:06 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:06 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-dcab517d-bf4d-4f25-9a3c-11a8ebce8896" returned: 0 in 0.362s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.729s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1914215890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdaa67ad-2820-457b-8893-3ec04aa57fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6b104c60dc47af86fa1a8a6f815e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:05Z,use_quota=True,user_id='1e975816f90b4e9bbc2b65e0da56c74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Creating volume cdaa67ad-2820-457b-8893-3ec04aa57fd7 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:06 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cdaa67ad-2820-457b-8893-3ec04aa57fd7 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:06 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cdaa67ad-2820-457b-8893-3ec04aa57fd7 1073741824 Sep 05 05:20:06 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48321f66-92fc-47b1-b0f7-b97ffafc9871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcab517d-bf4d-4f25-9a3c-11a8ebce8896', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:06 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff0c940-c4ed-42ad-b259-68cc091fb6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:06 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Volume volume-dcab517d-bf4d-4f25-9a3c-11a8ebce8896 (dcab517d-bf4d-4f25-9a3c-11a8ebce8896): created successfully Sep 05 05:20:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff0c940-c4ed-42ad-b259-68cc091fb6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Flow 'volume_create_manager' (57c3f156-e09f-4a70-8366-c7d4d9efb805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:07 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-06d1e21f-24c6-4585-b2e1-624fff0f1876 tempest-CreateVolumesFromImageTest-1075786189 None] Created volume successfully. Sep 05 05:20:07 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cdaa67ad-2820-457b-8893-3ec04aa57fd7 1073741824" returned: 0 in 0.627s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cdaa67ad-2820-457b-8893-3ec04aa57fd7 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:07 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cdaa67ad-2820-457b-8893-3ec04aa57fd7 Sep 05 05:20:07 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:07 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Flow 'volume_create_manager' (5127c2aa-7f49-470f-a8ec-318d0f3fde93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f19d703a-1e12-40ba-938b-c9dfa71121bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f19d703a-1e12-40ba-938b-c9dfa71121bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb09d58-d450-424c-9ff6-123f8f0d326b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c72648bf1b496197c796243233cb1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:08Z,use_quota=True,user_id='1bc0355cd7c843f89d10fa0bf6ffda71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b27680d-c73b-4f3e-bd5c-9857bb405fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b27680d-c73b-4f3e-bd5c-9857bb405fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dade2f7e-082f-4030-a041-3b915d61b06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:07 devstack cinder-volume[89331]: DEBUG cinder.image.glance [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Creating Keystone auth plugin from conf {{(pid=89331) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 05:20:07 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cdaa67ad-2820-457b-8893-3ec04aa57fd7" returned: 0 in 0.377s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:07 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a77dcba5-cd63-4ab9-a50b-9b8cb0729199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdaa67ad-2820-457b-8893-3ec04aa57fd7', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:07 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da550f8-ec5d-48f9-91d1-215d2ce39abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:08 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Volume volume-cdaa67ad-2820-457b-8893-3ec04aa57fd7 (cdaa67ad-2820-457b-8893-3ec04aa57fd7): created successfully Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da550f8-ec5d-48f9-91d1-215d2ce39abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Flow 'volume_create_manager' (b8a7b428-960b-4f14-a68c-d66d9636619c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:08 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-7cda983b-9a5b-49d1-ae72-c7298d07d37b tempest-CreateVolumesFromImageTest-1075786189 None] Created volume successfully. Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dade2f7e-082f-4030-a041-3b915d61b06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'edb09d58-d450-424c-9ff6-123f8f0d326b', 'volume_name': 'volume-edb09d58-d450-424c-9ff6-123f8f0d326b', 'volume_size': 1, 'image_id': '89fe7aa4-82d0-41fa-b7bb-80edce3ad857', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89fe7aa4-82d0-41fa-b7bb-80edce3ad857', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1274cfd557c8f0db45be2deca579b279', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f0c72648bf1b496197c796243233cb1b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35b36275752fb072e7839f926d19ceba0485654484b8cc834843d63a24634612888a85892140775b1848124634f7ffebf5959c0e45f480ba566aafb021f0ae4b', 'id': '89fe7aa4-82d0-41fa-b7bb-80edce3ad857', 'created_at': datetime.datetime(2026, 9, 5, 3, 20, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 3, 20, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89fe7aa4-82d0-41fa-b7bb-80edce3ad857/file', 'properties': {}}, 'image_service': }' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f58fff15-2034-467b-9e48-39cb44d2422e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f58fff15-2034-467b-9e48-39cb44d2422e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61a5e658-23fb-44d0-a660-d71d5d027eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:08 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Volume edb09d58-d450-424c-9ff6-123f8f0d326b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-edb09d58-d450-424c-9ff6-123f8f0d326b', 'volume_size': 1, 'image_id': '89fe7aa4-82d0-41fa-b7bb-80edce3ad857', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89fe7aa4-82d0-41fa-b7bb-80edce3ad857', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1274cfd557c8f0db45be2deca579b279', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f0c72648bf1b496197c796243233cb1b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35b36275752fb072e7839f926d19ceba0485654484b8cc834843d63a24634612888a85892140775b1848124634f7ffebf5959c0e45f480ba566aafb021f0ae4b', 'id': '89fe7aa4-82d0-41fa-b7bb-80edce3ad857', 'created_at': datetime.datetime(2026, 9, 5, 3, 20, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 3, 20, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89fe7aa4-82d0-41fa-b7bb-80edce3ad857/file', 'properties': {}}, 'image_service': } Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Trying to clone edb09d58-d450-424c-9ff6-123f8f0d326b from image 89fe7aa4-82d0-41fa-b7bb-80edce3ad857 at location (None, [{'url': 'file:///opt/stack/data/glance/images/89fe7aa4-82d0-41fa-b7bb-80edce3ad857', 'metadata': {}}]). {{(pid=89331) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2fb3cbc6-3253-4971-a10d-6226fcbf94db tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "cinder-cdaa67ad-2820-457b-8893-3ec04aa57fd7-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2fb3cbc6-3253-4971-a10d-6226fcbf94db tempest-CreateVolumesFromImageTest-1075786189 None] Lock "cinder-cdaa67ad-2820-457b-8893-3ec04aa57fd7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 05:20:08 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Image download 0.00 MB at 0.00 MB/s Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2fb3cbc6-3253-4971-a10d-6226fcbf94db tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "cinder-quobyte-cdaa67ad-2820-457b-8893-3ec04aa57fd7" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2fb3cbc6-3253-4971-a10d-6226fcbf94db tempest-CreateVolumesFromImageTest-1075786189 None] Lock "cinder-quobyte-cdaa67ad-2820-457b-8893-3ec04aa57fd7" acquired by "delete_volume" :: waited 0.019s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c0bf66-6176-4c42-a450-8f6578d782ea]: (4, 'raw') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[075738ef-6f9a-4ffb-b78f-41d0a415d079]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2fb3cbc6-3253-4971-a10d-6226fcbf94db tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cdaa67ad-2820-457b-8893-3ec04aa57fd7 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:08 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD Sep 05 05:20:08 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:08 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cdaa67ad-2820-457b-8893-3ec04aa57fd7 Sep 05 05:20:08 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Flow 'volume_create_manager' (3c7017ff-b366-42a8-8a80-960988a206d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d962495b-abc7-45dd-a9d2-58f999d8f39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d962495b-abc7-45dd-a9d2-58f999d8f39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411bf496-8ced-4b73-b4e8-f4ba809154ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b664c111ab49c6af8373c5ff0be0cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:09Z,use_quota=True,user_id='a1e60fadeb754bf49d6f397dfe32e5cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f640ea0c-2a7e-46b0-877a-2fb2e25bf852),volume_type_id=f640ea0c-2a7e-46b0-877a-2fb2e25bf852)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc684ae0-24f6-4aae-bd19-145b4367646e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc684ae0-24f6-4aae-bd19-145b4367646e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ced5f2a-cd00-43f9-a25d-ef0cb183641e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:08 devstack cinder-volume[89331]: DEBUG cinder.image.glance [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Creating Keystone auth plugin from conf {{(pid=89331) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 05:20:09 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2fb3cbc6-3253-4971-a10d-6226fcbf94db tempest-CreateVolumesFromImageTest-1075786189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cdaa67ad-2820-457b-8893-3ec04aa57fd7" returned: 0 in 0.476s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2fb3cbc6-3253-4971-a10d-6226fcbf94db tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cdaa67ad-2820-457b-8893-3ec04aa57fd7 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:09 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD" returned: 0 in 0.511s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:09 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cdaa67ad-2820-457b-8893-3ec04aa57fd7 Sep 05 05:20:09 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:09 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD Sep 05 05:20:09 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ced5f2a-cd00-43f9-a25d-ef0cb183641e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '411bf496-8ced-4b73-b4e8-f4ba809154ac', 'volume_name': 'volume-411bf496-8ced-4b73-b4e8-f4ba809154ac', 'volume_size': 1, 'image_id': '35146a79-3898-457f-ab7f-274a04339dcd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35146a79-3898-457f-ab7f-274a04339dcd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '919c4b31e3dc78a4eaa09f3a63d8a074', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '64b664c111ab49c6af8373c5ff0be0cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5944778a717a1950efda98509cecda5e0a904157a474c80743248c3c86e42a04da035a73e5f8726f4d482d8d21f78b4bf4bab62048cf31561659fe1c61eb655d', 'id': '35146a79-3898-457f-ab7f-274a04339dcd', 'created_at': datetime.datetime(2026, 9, 5, 3, 20, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 3, 20, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35146a79-3898-457f-ab7f-274a04339dcd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e36b5e-3d81-4613-a738-255d4d015a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e36b5e-3d81-4613-a738-255d4d015a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1100d6ee-9b96-46e2-aeb5-82a6f3830356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:09 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Volume 411bf496-8ced-4b73-b4e8-f4ba809154ac: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-411bf496-8ced-4b73-b4e8-f4ba809154ac', 'volume_size': 1, 'image_id': '35146a79-3898-457f-ab7f-274a04339dcd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35146a79-3898-457f-ab7f-274a04339dcd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '919c4b31e3dc78a4eaa09f3a63d8a074', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '64b664c111ab49c6af8373c5ff0be0cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5944778a717a1950efda98509cecda5e0a904157a474c80743248c3c86e42a04da035a73e5f8726f4d482d8d21f78b4bf4bab62048cf31561659fe1c61eb655d', 'id': '35146a79-3898-457f-ab7f-274a04339dcd', 'created_at': datetime.datetime(2026, 9, 5, 3, 20, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 3, 20, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35146a79-3898-457f-ab7f-274a04339dcd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Trying to clone 411bf496-8ced-4b73-b4e8-f4ba809154ac from image 35146a79-3898-457f-ab7f-274a04339dcd at location (None, [{'url': 'file:///opt/stack/data/glance/images/35146a79-3898-457f-ab7f-274a04339dcd', 'metadata': {}}]). {{(pid=89331) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 05:20:09 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2fb3cbc6-3253-4971-a10d-6226fcbf94db tempest-CreateVolumesFromImageTest-1075786189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cdaa67ad-2820-457b-8893-3ec04aa57fd7" returned: 0 in 0.290s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2fb3cbc6-3253-4971-a10d-6226fcbf94db tempest-CreateVolumesFromImageTest-1075786189 None] Lock "cinder-quobyte-cdaa67ad-2820-457b-8893-3ec04aa57fd7" released by "delete_volume" :: held 0.845s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 05:20:09 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Image download 0.00 MB at 0.00 MB/s Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b15e9d-8b71-4ece-80b1-9d94dad1a56c]: (4, 'raw') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-2fb3cbc6-3253-4971-a10d-6226fcbf94db tempest-CreateVolumesFromImageTest-1075786189 None] Created reservations ['22181aad-79ae-4692-b7cf-dd4ef12e33bd', 'beb1c8af-f665-488d-9504-8f03cce53dab', '0831623d-c134-4523-86df-6a69b4585e76', 'e001e47e-9c2e-4e35-b1dc-0f22ca4ac711'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:09 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD" returned: 1 in 0.399s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD' failed. Not Retrying. {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Temporary image 89fe7aa4-82d0-41fa-b7bb-80edce3ad857 is fetched for user 1bc0355cd7c843f89d10fa0bf6ffda71. {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 05:20:09 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD Sep 05 05:20:09 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2fb3cbc6-3253-4971-a10d-6226fcbf94db tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2fb3cbc6-3253-4971-a10d-6226fcbf94db tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2fb3cbc6-3253-4971-a10d-6226fcbf94db tempest-CreateVolumesFromImageTest-1075786189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2fb3cbc6-3253-4971-a10d-6226fcbf94db tempest-CreateVolumesFromImageTest-1075786189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2fb3cbc6-3253-4971-a10d-6226fcbf94db tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2fb3cbc6-3253-4971-a10d-6226fcbf94db tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d5281496-05f9-4a5b-bd5c-eb75d8fc02e9 tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "cinder-dcab517d-bf4d-4f25-9a3c-11a8ebce8896-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec07b352-ac0b-4fc9-83e5-47299178f688]: (4, 'raw') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:09 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:09 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d5281496-05f9-4a5b-bd5c-eb75d8fc02e9 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "cinder-dcab517d-bf4d-4f25-9a3c-11a8ebce8896-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d5281496-05f9-4a5b-bd5c-eb75d8fc02e9 tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "cinder-quobyte-dcab517d-bf4d-4f25-9a3c-11a8ebce8896" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d5281496-05f9-4a5b-bd5c-eb75d8fc02e9 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "cinder-quobyte-dcab517d-bf4d-4f25-9a3c-11a8ebce8896" acquired by "delete_volume" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea46dd84-4ed8-4cbb-b92d-95265a479869]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d5281496-05f9-4a5b-bd5c-eb75d8fc02e9 tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-dcab517d-bf4d-4f25-9a3c-11a8ebce8896 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:09 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD Sep 05 05:20:09 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:09 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-dcab517d-bf4d-4f25-9a3c-11a8ebce8896 Sep 05 05:20:09 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:09 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD" returned: 0 in 0.550s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:10 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2fb3cbc6-3253-4971-a10d-6226fcbf94db tempest-CreateVolumesFromImageTest-1075786189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.418s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-2fb3cbc6-3253-4971-a10d-6226fcbf94db tempest-CreateVolumesFromImageTest-1075786189 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:10 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-2fb3cbc6-3253-4971-a10d-6226fcbf94db tempest-CreateVolumesFromImageTest-1075786189 None] Deleted volume successfully. Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2fb3cbc6-3253-4971-a10d-6226fcbf94db tempest-CreateVolumesFromImageTest-1075786189 None] Lock "cinder-cdaa67ad-2820-457b-8893-3ec04aa57fd7-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:10 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD Sep 05 05:20:10 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:10 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD" returned: 0 in 0.531s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:10 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d5281496-05f9-4a5b-bd5c-eb75d8fc02e9 tempest-CreateVolumesFromImageTest-1075786189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-dcab517d-bf4d-4f25-9a3c-11a8ebce8896" returned: 0 in 0.422s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d5281496-05f9-4a5b-bd5c-eb75d8fc02e9 tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-dcab517d-bf4d-4f25-9a3c-11a8ebce8896 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:10 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-dcab517d-bf4d-4f25-9a3c-11a8ebce8896 Sep 05 05:20:10 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:10 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD Sep 05 05:20:10 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:10 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD" returned: 1 in 0.422s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD' failed. Not Retrying. {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Temporary image 35146a79-3898-457f-ab7f-274a04339dcd is fetched for user a1e60fadeb754bf49d6f397dfe32e5cc. {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[582567b1-234b-458f-af9e-8f4ad1e073cc]: (4, 'raw') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:10 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d5281496-05f9-4a5b-bd5c-eb75d8fc02e9 tempest-CreateVolumesFromImageTest-1075786189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-dcab517d-bf4d-4f25-9a3c-11a8ebce8896" returned: 0 in 0.305s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d5281496-05f9-4a5b-bd5c-eb75d8fc02e9 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "cinder-quobyte-dcab517d-bf4d-4f25-9a3c-11a8ebce8896" released by "delete_volume" :: held 0.796s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-d5281496-05f9-4a5b-bd5c-eb75d8fc02e9 tempest-CreateVolumesFromImageTest-1075786189 None] Created reservations ['c4beb79e-4af5-456b-ab61-96d7ad543f2e', '6e0a247b-6b7e-49e6-bfd5-900282d04f8f', 'afe5f547-8101-497f-8542-2995753fcb29', '124bdb4c-a0f1-4469-9f8e-590fdd341c06'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:10 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD" returned: 1 in 0.437s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD' failed. Not Retrying. {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb09d58-d450-424c-9ff6-123f8f0d326b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c72648bf1b496197c796243233cb1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:08Z,use_quota=True,user_id='1bc0355cd7c843f89d10fa0bf6ffda71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Creating volume edb09d58-d450-424c-9ff6-123f8f0d326b {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:10 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-edb09d58-d450-424c-9ff6-123f8f0d326b 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:10 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD Sep 05 05:20:10 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:10 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-edb09d58-d450-424c-9ff6-123f8f0d326b 1073741824 Sep 05 05:20:10 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d5281496-05f9-4a5b-bd5c-eb75d8fc02e9 tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d5281496-05f9-4a5b-bd5c-eb75d8fc02e9 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d5281496-05f9-4a5b-bd5c-eb75d8fc02e9 tempest-CreateVolumesFromImageTest-1075786189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d5281496-05f9-4a5b-bd5c-eb75d8fc02e9 tempest-CreateVolumesFromImageTest-1075786189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d5281496-05f9-4a5b-bd5c-eb75d8fc02e9 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d5281496-05f9-4a5b-bd5c-eb75d8fc02e9 tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:10 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:10 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Flow 'volume_create_manager' (0855d92a-aad2-495f-9701-678d95290d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc135a6e-7968-4dbe-90f4-70aaac9404b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc135a6e-7968-4dbe-90f4-70aaac9404b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1262325323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00843320-0c8a-4363-926b-8a9a93110598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddcd468ba4ee4f31ad43c9f153ba3f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:11Z,use_quota=True,user_id='5d90352309854303aa9a3d8d5110463e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8420b96f-d0d3-4313-af3c-04c14eccb201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8420b96f-d0d3-4313-af3c-04c14eccb201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71bdbb09-9447-48e7-9571-22c1ec0bd1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71bdbb09-9447-48e7-9571-22c1ec0bd1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00843320-0c8a-4363-926b-8a9a93110598', 'volume_name': 'volume-00843320-0c8a-4363-926b-8a9a93110598', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423886d2-d5c7-4904-852c-1b7ae4465518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423886d2-d5c7-4904-852c-1b7ae4465518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92b3212-7a79-45da-9777-8998c1a34a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:10 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Volume 00843320-0c8a-4363-926b-8a9a93110598: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00843320-0c8a-4363-926b-8a9a93110598', 'volume_size': 1} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-95d468ce-3711-42f4-87b1-fdef3663d86e tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "cinder-57732daf-50fc-4db0-b611-145bf607224a-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-95d468ce-3711-42f4-87b1-fdef3663d86e tempest-CreateVolumesFromImageTest-1075786189 None] Lock "cinder-57732daf-50fc-4db0-b611-145bf607224a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-95d468ce-3711-42f4-87b1-fdef3663d86e tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "cinder-quobyte-57732daf-50fc-4db0-b611-145bf607224a" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-95d468ce-3711-42f4-87b1-fdef3663d86e tempest-CreateVolumesFromImageTest-1075786189 None] Lock "cinder-quobyte-57732daf-50fc-4db0-b611-145bf607224a" acquired by "delete_volume" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cc68dd-7f02-4103-a9fd-bc0dccb31214]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-95d468ce-3711-42f4-87b1-fdef3663d86e tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57732daf-50fc-4db0-b611-145bf607224a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:11 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD" returned: 0 in 0.591s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:11 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d5281496-05f9-4a5b-bd5c-eb75d8fc02e9 tempest-CreateVolumesFromImageTest-1075786189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.340s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-d5281496-05f9-4a5b-bd5c-eb75d8fc02e9 tempest-CreateVolumesFromImageTest-1075786189 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:11 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-d5281496-05f9-4a5b-bd5c-eb75d8fc02e9 tempest-CreateVolumesFromImageTest-1075786189 None] Deleted volume successfully. Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d5281496-05f9-4a5b-bd5c-eb75d8fc02e9 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "cinder-dcab517d-bf4d-4f25-9a3c-11a8ebce8896-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:11 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57732daf-50fc-4db0-b611-145bf607224a Sep 05 05:20:11 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:11 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD Sep 05 05:20:11 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:11 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-edb09d58-d450-424c-9ff6-123f8f0d326b 1073741824" returned: 0 in 0.558s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-edb09d58-d450-424c-9ff6-123f8f0d326b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:11 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-edb09d58-d450-424c-9ff6-123f8f0d326b Sep 05 05:20:11 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:11 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD' failed. Not Retrying. {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:11 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-95d468ce-3711-42f4-87b1-fdef3663d86e tempest-CreateVolumesFromImageTest-1075786189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57732daf-50fc-4db0-b611-145bf607224a" returned: 0 in 0.387s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-95d468ce-3711-42f4-87b1-fdef3663d86e tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57732daf-50fc-4db0-b611-145bf607224a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:11 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57732daf-50fc-4db0-b611-145bf607224a Sep 05 05:20:11 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:11 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-edb09d58-d450-424c-9ff6-123f8f0d326b" returned: 0 in 0.261s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.642s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1262325323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00843320-0c8a-4363-926b-8a9a93110598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddcd468ba4ee4f31ad43c9f153ba3f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:11Z,use_quota=True,user_id='5d90352309854303aa9a3d8d5110463e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Creating volume 00843320-0c8a-4363-926b-8a9a93110598 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:11 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:11 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598 1073741824 Sep 05 05:20:11 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Attempting download of 89fe7aa4-82d0-41fa-b7bb-80edce3ad857 ((None, [{'url': 'file:///opt/stack/data/glance/images/89fe7aa4-82d0-41fa-b7bb-80edce3ad857', 'metadata': {}}])) to volume edb09d58-d450-424c-9ff6-123f8f0d326b. {{(pid=89331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff3ef85-870d-4a16-bc1a-54602e66fe4d]: (4, 'raw') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_wyxj8hzp {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:11 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-95d468ce-3711-42f4-87b1-fdef3663d86e tempest-CreateVolumesFromImageTest-1075786189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57732daf-50fc-4db0-b611-145bf607224a" returned: 0 in 0.297s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-95d468ce-3711-42f4-87b1-fdef3663d86e tempest-CreateVolumesFromImageTest-1075786189 None] Lock "cinder-quobyte-57732daf-50fc-4db0-b611-145bf607224a" released by "delete_volume" :: held 0.742s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:11 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_wyxj8hzp Sep 05 05:20:11 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-95d468ce-3711-42f4-87b1-fdef3663d86e tempest-CreateVolumesFromImageTest-1075786189 None] Created reservations ['165e7069-2646-40a7-bd70-765f31a04230', '8a7f23d6-8375-43d7-a300-ef5db43f60d4', 'c108f107-617b-4a2e-8b71-5330208c941c', '600c13e6-61b2-4966-b33a-00068ac899f0'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-95d468ce-3711-42f4-87b1-fdef3663d86e tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-95d468ce-3711-42f4-87b1-fdef3663d86e tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-95d468ce-3711-42f4-87b1-fdef3663d86e tempest-CreateVolumesFromImageTest-1075786189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-95d468ce-3711-42f4-87b1-fdef3663d86e tempest-CreateVolumesFromImageTest-1075786189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-95d468ce-3711-42f4-87b1-fdef3663d86e tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-95d468ce-3711-42f4-87b1-fdef3663d86e tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:11 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:11 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:12 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_wyxj8hzp" returned: 0 in 0.404s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_wyxj8hzp {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:12 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598 1073741824" returned: 0 in 0.544s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fbd971c-e8e2-4586-bfa3-83f608e1f3ce tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "cinder-68513e1b-41c6-4279-832e-99eefaae06fd-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fbd971c-e8e2-4586-bfa3-83f608e1f3ce tempest-CreateVolumesFromImageTest-1075786189 None] Lock "cinder-68513e1b-41c6-4279-832e-99eefaae06fd-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:12 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598 Sep 05 05:20:12 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:12 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fbd971c-e8e2-4586-bfa3-83f608e1f3ce tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "cinder-quobyte-68513e1b-41c6-4279-832e-99eefaae06fd" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:12 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_wyxj8hzp Sep 05 05:20:12 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-95d468ce-3711-42f4-87b1-fdef3663d86e tempest-CreateVolumesFromImageTest-1075786189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.324s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-95d468ce-3711-42f4-87b1-fdef3663d86e tempest-CreateVolumesFromImageTest-1075786189 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:12 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-95d468ce-3711-42f4-87b1-fdef3663d86e tempest-CreateVolumesFromImageTest-1075786189 None] Deleted volume successfully. Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fbd971c-e8e2-4586-bfa3-83f608e1f3ce tempest-CreateVolumesFromImageTest-1075786189 None] Lock "cinder-quobyte-68513e1b-41c6-4279-832e-99eefaae06fd" acquired by "delete_volume" :: waited 0.028s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-95d468ce-3711-42f4-87b1-fdef3663d86e tempest-CreateVolumesFromImageTest-1075786189 None] Lock "cinder-57732daf-50fc-4db0-b611-145bf607224a-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b67dd20-2424-4d8d-9f20-ef218591aa9b]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fbd971c-e8e2-4586-bfa3-83f608e1f3ce tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-68513e1b-41c6-4279-832e-99eefaae06fd {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:12 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-68513e1b-41c6-4279-832e-99eefaae06fd Sep 05 05:20:12 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:12 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598" returned: 0 in 0.273s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.997s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411bf496-8ced-4b73-b4e8-f4ba809154ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b664c111ab49c6af8373c5ff0be0cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:09Z,use_quota=True,user_id='a1e60fadeb754bf49d6f397dfe32e5cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f640ea0c-2a7e-46b0-877a-2fb2e25bf852),volume_type_id=f640ea0c-2a7e-46b0-877a-2fb2e25bf852)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Creating volume 411bf496-8ced-4b73-b4e8-f4ba809154ac {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:12 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-411bf496-8ced-4b73-b4e8-f4ba809154ac 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:12 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92b3212-7a79-45da-9777-8998c1a34a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00843320-0c8a-4363-926b-8a9a93110598', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75716d7-27d8-4d20-b668-21f9371160f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:12 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-411bf496-8ced-4b73-b4e8-f4ba809154ac 1073741824 Sep 05 05:20:12 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_wyxj8hzp" returned: 1 in 0.430s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_wyxj8hzp' failed. Not Retrying. {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[54520a90-e3fb-4d62-a2e2-49483500075b]: (4, 'raw') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:12 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Volume volume-00843320-0c8a-4363-926b-8a9a93110598 (00843320-0c8a-4363-926b-8a9a93110598): created successfully Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75716d7-27d8-4d20-b668-21f9371160f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Flow 'volume_create_manager' (0855d92a-aad2-495f-9701-678d95290d3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:12 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ffe63a23-d66e-44be-92c1-187a467c7886 tempest-ProjectReaderTests-544844019 None] Created volume successfully. Sep 05 05:20:12 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD Sep 05 05:20:12 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:12 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fbd971c-e8e2-4586-bfa3-83f608e1f3ce tempest-CreateVolumesFromImageTest-1075786189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-68513e1b-41c6-4279-832e-99eefaae06fd" returned: 0 in 0.402s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fbd971c-e8e2-4586-bfa3-83f608e1f3ce tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-68513e1b-41c6-4279-832e-99eefaae06fd {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:12 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-68513e1b-41c6-4279-832e-99eefaae06fd Sep 05 05:20:12 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:12 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD" returned: 0 in 0.392s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:12 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fbd971c-e8e2-4586-bfa3-83f608e1f3ce tempest-CreateVolumesFromImageTest-1075786189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-68513e1b-41c6-4279-832e-99eefaae06fd" returned: 0 in 0.297s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fbd971c-e8e2-4586-bfa3-83f608e1f3ce tempest-CreateVolumesFromImageTest-1075786189 None] Lock "cinder-quobyte-68513e1b-41c6-4279-832e-99eefaae06fd" released by "delete_volume" :: held 0.751s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:13 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:13 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD Sep 05 05:20:13 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-411bf496-8ced-4b73-b4e8-f4ba809154ac 1073741824" returned: 0 in 0.566s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-411bf496-8ced-4b73-b4e8-f4ba809154ac {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-021d1b8b-08ad-4bd9-8699-33a1c5de1615 tempest-ProjectReaderTests-544844019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:13 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-411bf496-8ced-4b73-b4e8-f4ba809154ac Sep 05 05:20:13 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-3fbd971c-e8e2-4586-bfa3-83f608e1f3ce tempest-CreateVolumesFromImageTest-1075786189 None] Created reservations ['e5e1f5be-1031-47bc-95eb-213a4a91b106', '30df1786-70f1-4a49-8f82-ba2cf9ee3d76', '9227cd26-38e7-408d-8b1c-0b9856147d14', 'eb4a40ee-d206-4f4f-b278-9f47501c8015'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3fbd971c-e8e2-4586-bfa3-83f608e1f3ce tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3fbd971c-e8e2-4586-bfa3-83f608e1f3ce tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3fbd971c-e8e2-4586-bfa3-83f608e1f3ce tempest-CreateVolumesFromImageTest-1075786189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3fbd971c-e8e2-4586-bfa3-83f608e1f3ce tempest-CreateVolumesFromImageTest-1075786189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3fbd971c-e8e2-4586-bfa3-83f608e1f3ce tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fbd971c-e8e2-4586-bfa3-83f608e1f3ce tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:13 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:13 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:13 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD" returned: 1 in 0.454s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD' failed. Not Retrying. {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] 89fe7aa4-82d0-41fa-b7bb-80edce3ad857 was raw, converting to qcow2 {{(pid=89331) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-edb09d58-d450-424c-9ff6-123f8f0d326b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d3a58ff7-5904-49cd-86e3-987c2f521082 tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "cinder-23d97ebd-7523-4d5e-b72e-a501b9e8a224-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:13 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-411bf496-8ced-4b73-b4e8-f4ba809154ac" returned: 0 in 0.308s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:13 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-edb09d58-d450-424c-9ff6-123f8f0d326b Sep 05 05:20:13 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-021d1b8b-08ad-4bd9-8699-33a1c5de1615 tempest-ProjectReaderTests-544844019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.288s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d3a58ff7-5904-49cd-86e3-987c2f521082 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "cinder-23d97ebd-7523-4d5e-b72e-a501b9e8a224-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-021d1b8b-08ad-4bd9-8699-33a1c5de1615 tempest-ProjectReaderTests-544844019 None] Creating offline snapshot 502298ca-d713-4ab3-9ab1-67dc0b4c1934 of volume 00843320-0c8a-4363-926b-8a9a93110598 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcca394-056d-46e8-9363-eb56f1de00d5]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-021d1b8b-08ad-4bd9-8699-33a1c5de1615 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Attempting download of 35146a79-3898-457f-ab7f-274a04339dcd ((None, [{'url': 'file:///opt/stack/data/glance/images/35146a79-3898-457f-ab7f-274a04339dcd', 'metadata': {}}])) to volume 411bf496-8ced-4b73-b4e8-f4ba809154ac. {{(pid=89331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d3a58ff7-5904-49cd-86e3-987c2f521082 tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "cinder-quobyte-23d97ebd-7523-4d5e-b72e-a501b9e8a224" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:13 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3fbd971c-e8e2-4586-bfa3-83f608e1f3ce tempest-CreateVolumesFromImageTest-1075786189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.322s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-3fbd971c-e8e2-4586-bfa3-83f608e1f3ce tempest-CreateVolumesFromImageTest-1075786189 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:13 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-3fbd971c-e8e2-4586-bfa3-83f608e1f3ce tempest-CreateVolumesFromImageTest-1075786189 None] Deleted volume successfully. Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d3a58ff7-5904-49cd-86e3-987c2f521082 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "cinder-quobyte-23d97ebd-7523-4d5e-b72e-a501b9e8a224" acquired by "delete_volume" :: waited 0.044s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb178af5-bbe4-46ea-9577-eb649dfd4ade]: (4, 'raw') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35146a79-3898-457f-ab7f-274a04339dcd_aaoxj8be {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fd27b1-e844-48ea-99e3-c659f0058404]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d3a58ff7-5904-49cd-86e3-987c2f521082 tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23d97ebd-7523-4d5e-b72e-a501b9e8a224 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:13 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598 Sep 05 05:20:13 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3fbd971c-e8e2-4586-bfa3-83f608e1f3ce tempest-CreateVolumesFromImageTest-1075786189 None] Lock "cinder-68513e1b-41c6-4279-832e-99eefaae06fd-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:13 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23d97ebd-7523-4d5e-b72e-a501b9e8a224 Sep 05 05:20:13 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:13 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35146a79-3898-457f-ab7f-274a04339dcd_aaoxj8be Sep 05 05:20:13 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:13 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-edb09d58-d450-424c-9ff6-123f8f0d326b" returned: 0 in 0.502s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_89fe7aa4-82d0-41fa-b7bb-80edce3ad857_8pwkpe91devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-edb09d58-d450-424c-9ff6-123f8f0d326b {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:20:13 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Converted 0.00 MB image at 0.00 MB/s Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-edb09d58-d450-424c-9ff6-123f8f0d326b 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:13 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-021d1b8b-08ad-4bd9-8699-33a1c5de1615 tempest-ProjectReaderTests-544844019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598" returned: 0 in 0.418s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-021d1b8b-08ad-4bd9-8699-33a1c5de1615 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.502298ca-d713-4ab3-9ab1-67dc0b4c1934 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:13 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-edb09d58-d450-424c-9ff6-123f8f0d326b 1G Sep 05 05:20:13 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:13 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.502298ca-d713-4ab3-9ab1-67dc0b4c1934 1G Sep 05 05:20:13 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:13 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35146a79-3898-457f-ab7f-274a04339dcd_aaoxj8be" returned: 0 in 0.392s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35146a79-3898-457f-ab7f-274a04339dcd_aaoxj8be {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:14 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d3a58ff7-5904-49cd-86e3-987c2f521082 tempest-CreateVolumesFromImageTest-1075786189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23d97ebd-7523-4d5e-b72e-a501b9e8a224" returned: 0 in 0.418s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d3a58ff7-5904-49cd-86e3-987c2f521082 tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23d97ebd-7523-4d5e-b72e-a501b9e8a224 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:14 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23d97ebd-7523-4d5e-b72e-a501b9e8a224 Sep 05 05:20:14 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:14 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35146a79-3898-457f-ab7f-274a04339dcd_aaoxj8be Sep 05 05:20:14 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:14 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-edb09d58-d450-424c-9ff6-123f8f0d326b 1G" returned: 0 in 0.400s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Downloaded image 89fe7aa4-82d0-41fa-b7bb-80edce3ad857 ((None, [{'url': 'file:///opt/stack/data/glance/images/89fe7aa4-82d0-41fa-b7bb-80edce3ad857', 'metadata': {}}])) to volume edb09d58-d450-424c-9ff6-123f8f0d326b successfully. {{(pid=89331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Temporary image 89fe7aa4-82d0-41fa-b7bb-80edce3ad857 for user 1bc0355cd7c843f89d10fa0bf6ffda71 is deleted. {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Marking volume edb09d58-d450-424c-9ff6-123f8f0d326b as bootable. {{(pid=89331) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Copying metadata from image 89fe7aa4-82d0-41fa-b7bb-80edce3ad857 to edb09d58-d450-424c-9ff6-123f8f0d326b. {{(pid=89331) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Creating volume glance metadata for volume edb09d58-d450-424c-9ff6-123f8f0d326b backed by image 89fe7aa4-82d0-41fa-b7bb-80edce3ad857 with: {'image_id': '89fe7aa4-82d0-41fa-b7bb-80edce3ad857', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1274cfd557c8f0db45be2deca579b279', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89331) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 05:20:14 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d3a58ff7-5904-49cd-86e3-987c2f521082 tempest-CreateVolumesFromImageTest-1075786189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-23d97ebd-7523-4d5e-b72e-a501b9e8a224" returned: 0 in 0.298s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:14 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d3a58ff7-5904-49cd-86e3-987c2f521082 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "cinder-quobyte-23d97ebd-7523-4d5e-b72e-a501b9e8a224" released by "delete_volume" :: held 0.781s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-021d1b8b-08ad-4bd9-8699-33a1c5de1615 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.502298ca-d713-4ab3-9ab1-67dc0b4c1934 1G" returned: 0 in 0.468s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-021d1b8b-08ad-4bd9-8699-33a1c5de1615 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00843320-0c8a-4363-926b-8a9a93110598 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.502298ca-d713-4ab3-9ab1-67dc0b4c1934 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:14 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00843320-0c8a-4363-926b-8a9a93110598 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.502298ca-d713-4ab3-9ab1-67dc0b4c1934 Sep 05 05:20:14 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:14 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35146a79-3898-457f-ab7f-274a04339dcd_aaoxj8be" returned: 1 in 0.439s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35146a79-3898-457f-ab7f-274a04339dcd_aaoxj8be' failed. Not Retrying. {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb83ce08-be22-487c-9641-13a639b94ce9]: (4, 'raw') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61a5e658-23fb-44d0-a660-d71d5d027eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edb09d58-d450-424c-9ff6-123f8f0d326b', 'volume_size': 1, 'image_id': '89fe7aa4-82d0-41fa-b7bb-80edce3ad857', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89fe7aa4-82d0-41fa-b7bb-80edce3ad857', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1274cfd557c8f0db45be2deca579b279', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f0c72648bf1b496197c796243233cb1b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35b36275752fb072e7839f926d19ceba0485654484b8cc834843d63a24634612888a85892140775b1848124634f7ffebf5959c0e45f480ba566aafb021f0ae4b', 'id': '89fe7aa4-82d0-41fa-b7bb-80edce3ad857', 'created_at': datetime.datetime(2026, 9, 5, 3, 20, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 3, 20, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89fe7aa4-82d0-41fa-b7bb-80edce3ad857/file', 'properties': {}}, 'image_service': }' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f167f453-89e0-4770-bd0a-c74a713a1a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-d3a58ff7-5904-49cd-86e3-987c2f521082 tempest-CreateVolumesFromImageTest-1075786189 None] Created reservations ['04e359fa-1a0d-4935-a0ac-4caa6fce1e75', 'b1f1b924-b6b1-4cff-8f9d-aae43b23907b', 'e9342ede-a65a-41af-8c7b-5ebe8920b9a7', 'a8cb9139-ec11-4abe-ad71-468ea869f992'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:14 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Volume volume-edb09d58-d450-424c-9ff6-123f8f0d326b (edb09d58-d450-424c-9ff6-123f8f0d326b): created successfully Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f167f453-89e0-4770-bd0a-c74a713a1a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Flow 'volume_create_manager' (5127c2aa-7f49-470f-a8ec-318d0f3fde93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:14 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-e728f735-8c16-4294-824d-c1abe770f835 tempest-VolumeImageDependencyTests-69908908 None] Created volume successfully. Sep 05 05:20:14 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD Sep 05 05:20:14 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d3a58ff7-5904-49cd-86e3-987c2f521082 tempest-CreateVolumesFromImageTest-1075786189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d3a58ff7-5904-49cd-86e3-987c2f521082 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d3a58ff7-5904-49cd-86e3-987c2f521082 tempest-CreateVolumesFromImageTest-1075786189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d3a58ff7-5904-49cd-86e3-987c2f521082 tempest-CreateVolumesFromImageTest-1075786189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d3a58ff7-5904-49cd-86e3-987c2f521082 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d3a58ff7-5904-49cd-86e3-987c2f521082 tempest-CreateVolumesFromImageTest-1075786189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:14 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:14 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:14 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-021d1b8b-08ad-4bd9-8699-33a1c5de1615 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00843320-0c8a-4363-926b-8a9a93110598 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.502298ca-d713-4ab3-9ab1-67dc0b4c1934" returned: 0 in 0.322s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:14 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-021d1b8b-08ad-4bd9-8699-33a1c5de1615 tempest-ProjectReaderTests-544844019 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.502298ca-d713-4ab3-9ab1-67dc0b4c1934 is being set with open permissions: ugo+rw Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-021d1b8b-08ad-4bd9-8699-33a1c5de1615 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.502298ca-d713-4ab3-9ab1-67dc0b4c1934 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:14 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.502298ca-d713-4ab3-9ab1-67dc0b4c1934 Sep 05 05:20:14 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:14 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:14 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d3a58ff7-5904-49cd-86e3-987c2f521082 tempest-CreateVolumesFromImageTest-1075786189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.254s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-d3a58ff7-5904-49cd-86e3-987c2f521082 tempest-CreateVolumesFromImageTest-1075786189 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:14 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-d3a58ff7-5904-49cd-86e3-987c2f521082 tempest-CreateVolumesFromImageTest-1075786189 None] Deleted volume successfully. Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d3a58ff7-5904-49cd-86e3-987c2f521082 tempest-CreateVolumesFromImageTest-1075786189 None] Lock "cinder-23d97ebd-7523-4d5e-b72e-a501b9e8a224-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:14 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD Sep 05 05:20:14 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:14 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-021d1b8b-08ad-4bd9-8699-33a1c5de1615 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.502298ca-d713-4ab3-9ab1-67dc0b4c1934" returned: 0 in 0.266s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-021d1b8b-08ad-4bd9-8699-33a1c5de1615 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:15 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.info Sep 05 05:20:15 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:15 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD" returned: 1 in 0.341s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD' failed. Not Retrying. {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 05:20:15 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] 35146a79-3898-457f-ab7f-274a04339dcd was raw, converting to qcow2 {{(pid=89331) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 05:20:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-411bf496-8ced-4b73-b4e8-f4ba809154ac {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:15 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-411bf496-8ced-4b73-b4e8-f4ba809154ac Sep 05 05:20:15 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:15 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-021d1b8b-08ad-4bd9-8699-33a1c5de1615 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.info" returned: 0 in 0.263s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:15 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-021d1b8b-08ad-4bd9-8699-33a1c5de1615 tempest-ProjectReaderTests-544844019 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.info is being set with open permissions: ugo+rw Sep 05 05:20:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-021d1b8b-08ad-4bd9-8699-33a1c5de1615 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:15 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.info Sep 05 05:20:15 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:15 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-021d1b8b-08ad-4bd9-8699-33a1c5de1615 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.info" returned: 0 in 0.260s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-021d1b8b-08ad-4bd9-8699-33a1c5de1615 tempest-ProjectReaderTests-544844019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.106s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:15 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-021d1b8b-08ad-4bd9-8699-33a1c5de1615 tempest-ProjectReaderTests-544844019 None] Create snapshot completed successfully Sep 05 05:20:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ecd2db3e-ce38-4e40-812e-1b7cb1f89f9a tempest-VolumeImageDependencyTests-69908908 None] Acquiring lock "cinder-edb09d58-d450-424c-9ff6-123f8f0d326b-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ecd2db3e-ce38-4e40-812e-1b7cb1f89f9a tempest-VolumeImageDependencyTests-69908908 None] Lock "cinder-edb09d58-d450-424c-9ff6-123f8f0d326b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ecd2db3e-ce38-4e40-812e-1b7cb1f89f9a tempest-VolumeImageDependencyTests-69908908 None] Acquiring lock "cinder-quobyte-edb09d58-d450-424c-9ff6-123f8f0d326b" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ecd2db3e-ce38-4e40-812e-1b7cb1f89f9a tempest-VolumeImageDependencyTests-69908908 None] Lock "cinder-quobyte-edb09d58-d450-424c-9ff6-123f8f0d326b" acquired by "delete_volume" :: waited 0.016s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:15 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[438f4427-6f33-4f1d-86b5-ec273ad2d620]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ecd2db3e-ce38-4e40-812e-1b7cb1f89f9a tempest-VolumeImageDependencyTests-69908908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-edb09d58-d450-424c-9ff6-123f8f0d326b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:15 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-411bf496-8ced-4b73-b4e8-f4ba809154ac" returned: 0 in 0.568s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:15 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_35146a79-3898-457f-ab7f-274a04339dcd_drjy3ziidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-411bf496-8ced-4b73-b4e8-f4ba809154ac {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:20:15 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Converted 0.00 MB image at 0.00 MB/s Sep 05 05:20:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-411bf496-8ced-4b73-b4e8-f4ba809154ac 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:15 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-411bf496-8ced-4b73-b4e8-f4ba809154ac 1G Sep 05 05:20:15 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:15 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-edb09d58-d450-424c-9ff6-123f8f0d326b Sep 05 05:20:15 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:16 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-411bf496-8ced-4b73-b4e8-f4ba809154ac 1G" returned: 0 in 0.342s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Downloaded image 35146a79-3898-457f-ab7f-274a04339dcd ((None, [{'url': 'file:///opt/stack/data/glance/images/35146a79-3898-457f-ab7f-274a04339dcd', 'metadata': {}}])) to volume 411bf496-8ced-4b73-b4e8-f4ba809154ac successfully. {{(pid=89331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Temporary image 35146a79-3898-457f-ab7f-274a04339dcd for user a1e60fadeb754bf49d6f397dfe32e5cc is deleted. {{(pid=89331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.volume.volume_utils [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Marking volume 411bf496-8ced-4b73-b4e8-f4ba809154ac as bootable. {{(pid=89331) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Copying metadata from image 35146a79-3898-457f-ab7f-274a04339dcd to 411bf496-8ced-4b73-b4e8-f4ba809154ac. {{(pid=89331) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Creating volume glance metadata for volume 411bf496-8ced-4b73-b4e8-f4ba809154ac backed by image 35146a79-3898-457f-ab7f-274a04339dcd with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '35146a79-3898-457f-ab7f-274a04339dcd', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '919c4b31e3dc78a4eaa09f3a63d8a074', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89331) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 05:20:16 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ecd2db3e-ce38-4e40-812e-1b7cb1f89f9a tempest-VolumeImageDependencyTests-69908908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-edb09d58-d450-424c-9ff6-123f8f0d326b" returned: 0 in 0.408s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ecd2db3e-ce38-4e40-812e-1b7cb1f89f9a tempest-VolumeImageDependencyTests-69908908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-edb09d58-d450-424c-9ff6-123f8f0d326b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:16 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-edb09d58-d450-424c-9ff6-123f8f0d326b Sep 05 05:20:16 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1100d6ee-9b96-46e2-aeb5-82a6f3830356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-411bf496-8ced-4b73-b4e8-f4ba809154ac', 'volume_size': 1, 'image_id': '35146a79-3898-457f-ab7f-274a04339dcd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35146a79-3898-457f-ab7f-274a04339dcd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '919c4b31e3dc78a4eaa09f3a63d8a074', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '64b664c111ab49c6af8373c5ff0be0cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5944778a717a1950efda98509cecda5e0a904157a474c80743248c3c86e42a04da035a73e5f8726f4d482d8d21f78b4bf4bab62048cf31561659fe1c61eb655d', 'id': '35146a79-3898-457f-ab7f-274a04339dcd', 'created_at': datetime.datetime(2026, 9, 5, 3, 20, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 3, 20, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35146a79-3898-457f-ab7f-274a04339dcd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be60f03-15ae-44bb-9af1-fd58042e663f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:16 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Volume volume-411bf496-8ced-4b73-b4e8-f4ba809154ac (411bf496-8ced-4b73-b4e8-f4ba809154ac): created successfully Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be60f03-15ae-44bb-9af1-fd58042e663f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Flow 'volume_create_manager' (3c7017ff-b366-42a8-8a80-960988a206d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:16 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-14183055-1212-4bfa-b553-6ea91f7fbaf7 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Created volume successfully. Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-47426d27-9c52-4cb5-bafc-8345ae44a014 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Acquiring lock "cinder-411bf496-8ced-4b73-b4e8-f4ba809154ac-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-47426d27-9c52-4cb5-bafc-8345ae44a014 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Lock "cinder-411bf496-8ced-4b73-b4e8-f4ba809154ac-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:16 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-47426d27-9c52-4cb5-bafc-8345ae44a014 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Acquiring lock "cinder-quobyte-411bf496-8ced-4b73-b4e8-f4ba809154ac" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ecd2db3e-ce38-4e40-812e-1b7cb1f89f9a tempest-VolumeImageDependencyTests-69908908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-edb09d58-d450-424c-9ff6-123f8f0d326b" returned: 0 in 0.412s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ecd2db3e-ce38-4e40-812e-1b7cb1f89f9a tempest-VolumeImageDependencyTests-69908908 None] Lock "cinder-quobyte-edb09d58-d450-424c-9ff6-123f8f0d326b" released by "delete_volume" :: held 0.875s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-47426d27-9c52-4cb5-bafc-8345ae44a014 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Lock "cinder-quobyte-411bf496-8ced-4b73-b4e8-f4ba809154ac" acquired by "delete_volume" :: waited 0.035s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce004aa-9d1c-4a15-b5ce-238452073144]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-47426d27-9c52-4cb5-bafc-8345ae44a014 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-411bf496-8ced-4b73-b4e8-f4ba809154ac {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d3173310-a04b-46af-ae6c-b47bbe29abc6 tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-502298ca-d713-4ab3-9ab1-67dc0b4c1934-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-ecd2db3e-ce38-4e40-812e-1b7cb1f89f9a tempest-VolumeImageDependencyTests-69908908 None] Created reservations ['ac00f49d-e9e2-4c48-b495-215c16764fe8', '208f3ac4-a365-4f27-b255-7dbd70eaa8d0', '94bce0a8-df69-4093-9549-3457fea64188', '272026c2-47d8-4dc7-9742-7b294ca2dc94'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d3173310-a04b-46af-ae6c-b47bbe29abc6 tempest-ProjectReaderTests-544844019 None] Lock "cinder-502298ca-d713-4ab3-9ab1-67dc0b4c1934-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d3173310-a04b-46af-ae6c-b47bbe29abc6 tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-quobyte-00843320-0c8a-4363-926b-8a9a93110598" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d3173310-a04b-46af-ae6c-b47bbe29abc6 tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-00843320-0c8a-4363-926b-8a9a93110598" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d3173310-a04b-46af-ae6c-b47bbe29abc6 tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-quobyte-502298ca-d713-4ab3-9ab1-67dc0b4c1934" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d3173310-a04b-46af-ae6c-b47bbe29abc6 tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-502298ca-d713-4ab3-9ab1-67dc0b4c1934" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-d3173310-a04b-46af-ae6c-b47bbe29abc6 tempest-ProjectReaderTests-544844019 None] Deleting offline snapshot 502298ca-d713-4ab3-9ab1-67dc0b4c1934 of volume 00843320-0c8a-4363-926b-8a9a93110598 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:20:16 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-411bf496-8ced-4b73-b4e8-f4ba809154ac Sep 05 05:20:16 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-d3173310-a04b-46af-ae6c-b47bbe29abc6 tempest-ProjectReaderTests-544844019 None] snapshot_file for this snap is: volume-00843320-0c8a-4363-926b-8a9a93110598.502298ca-d713-4ab3-9ab1-67dc0b4c1934 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb299782-4961-48b0-99b6-d0d4408db69b]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d3173310-a04b-46af-ae6c-b47bbe29abc6 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.502298ca-d713-4ab3-9ab1-67dc0b4c1934 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ecd2db3e-ce38-4e40-812e-1b7cb1f89f9a tempest-VolumeImageDependencyTests-69908908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ecd2db3e-ce38-4e40-812e-1b7cb1f89f9a tempest-VolumeImageDependencyTests-69908908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ecd2db3e-ce38-4e40-812e-1b7cb1f89f9a tempest-VolumeImageDependencyTests-69908908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ecd2db3e-ce38-4e40-812e-1b7cb1f89f9a tempest-VolumeImageDependencyTests-69908908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ecd2db3e-ce38-4e40-812e-1b7cb1f89f9a tempest-VolumeImageDependencyTests-69908908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ecd2db3e-ce38-4e40-812e-1b7cb1f89f9a tempest-VolumeImageDependencyTests-69908908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:16 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:16 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:16 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.502298ca-d713-4ab3-9ab1-67dc0b4c1934 Sep 05 05:20:16 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:17 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-47426d27-9c52-4cb5-bafc-8345ae44a014 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-411bf496-8ced-4b73-b4e8-f4ba809154ac" returned: 0 in 0.580s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-47426d27-9c52-4cb5-bafc-8345ae44a014 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-411bf496-8ced-4b73-b4e8-f4ba809154ac {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:17 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-411bf496-8ced-4b73-b4e8-f4ba809154ac Sep 05 05:20:17 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:17 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ecd2db3e-ce38-4e40-812e-1b7cb1f89f9a tempest-VolumeImageDependencyTests-69908908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.382s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:17 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-ecd2db3e-ce38-4e40-812e-1b7cb1f89f9a tempest-VolumeImageDependencyTests-69908908 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:17 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:17 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ecd2db3e-ce38-4e40-812e-1b7cb1f89f9a tempest-VolumeImageDependencyTests-69908908 None] Deleted volume successfully. Sep 05 05:20:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d3173310-a04b-46af-ae6c-b47bbe29abc6 tempest-ProjectReaderTests-544844019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.502298ca-d713-4ab3-9ab1-67dc0b4c1934" returned: 0 in 0.497s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-d3173310-a04b-46af-ae6c-b47bbe29abc6 tempest-ProjectReaderTests-544844019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00843320-0c8a-4363-926b-8a9a93110598(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:20:17 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[942fe9d8-5ac3-4641-b3fe-36cd9d367ec3]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d3173310-a04b-46af-ae6c-b47bbe29abc6 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:17 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ecd2db3e-ce38-4e40-812e-1b7cb1f89f9a tempest-VolumeImageDependencyTests-69908908 None] Lock "cinder-edb09d58-d450-424c-9ff6-123f8f0d326b-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:17 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598 Sep 05 05:20:17 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:17 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-47426d27-9c52-4cb5-bafc-8345ae44a014 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-411bf496-8ced-4b73-b4e8-f4ba809154ac" returned: 0 in 0.397s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:17 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-47426d27-9c52-4cb5-bafc-8345ae44a014 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Lock "cinder-quobyte-411bf496-8ced-4b73-b4e8-f4ba809154ac" released by "delete_volume" :: held 1.048s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:17 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-47426d27-9c52-4cb5-bafc-8345ae44a014 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Created reservations ['481f5399-5c77-4150-b124-d1c317cc51da', '9153f7cc-637c-4208-814c-b7a3f10bc3e9', '744fd659-18c7-42d6-8801-e4b250818414', 'f119f27a-0520-404d-82dd-5c1caad7de64'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-47426d27-9c52-4cb5-bafc-8345ae44a014 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-47426d27-9c52-4cb5-bafc-8345ae44a014 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-47426d27-9c52-4cb5-bafc-8345ae44a014 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:17 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-47426d27-9c52-4cb5-bafc-8345ae44a014 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-47426d27-9c52-4cb5-bafc-8345ae44a014 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-47426d27-9c52-4cb5-bafc-8345ae44a014 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:17 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d3173310-a04b-46af-ae6c-b47bbe29abc6 tempest-ProjectReaderTests-544844019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598" returned: 0 in 0.496s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d3173310-a04b-46af-ae6c-b47bbe29abc6 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.502298ca-d713-4ab3-9ab1-67dc0b4c1934 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:17 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:17 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:17 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.502298ca-d713-4ab3-9ab1-67dc0b4c1934 Sep 05 05:20:17 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:18 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-47426d27-9c52-4cb5-bafc-8345ae44a014 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.284s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:18 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-47426d27-9c52-4cb5-bafc-8345ae44a014 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:18 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-47426d27-9c52-4cb5-bafc-8345ae44a014 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Deleted volume successfully. Sep 05 05:20:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-47426d27-9c52-4cb5-bafc-8345ae44a014 tempest-VolumeAndVolumeTypeFromImageTest-1609708123 None] Lock "cinder-411bf496-8ced-4b73-b4e8-f4ba809154ac-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:18 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d3173310-a04b-46af-ae6c-b47bbe29abc6 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.502298ca-d713-4ab3-9ab1-67dc0b4c1934" returned: 0 in 0.419s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d3173310-a04b-46af-ae6c-b47bbe29abc6 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.502298ca-d713-4ab3-9ab1-67dc0b4c1934 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:18 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.502298ca-d713-4ab3-9ab1-67dc0b4c1934 Sep 05 05:20:18 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:18 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d3173310-a04b-46af-ae6c-b47bbe29abc6 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598.502298ca-d713-4ab3-9ab1-67dc0b4c1934" returned: 0 in 0.268s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d3173310-a04b-46af-ae6c-b47bbe29abc6 tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-502298ca-d713-4ab3-9ab1-67dc0b4c1934" released by "_delete_snapshot" :: held 1.846s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d3173310-a04b-46af-ae6c-b47bbe29abc6 tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-00843320-0c8a-4363-926b-8a9a93110598" released by "delete_snapshot" :: held 1.876s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:18 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-d3173310-a04b-46af-ae6c-b47bbe29abc6 tempest-ProjectReaderTests-544844019 None] Created reservations ['174f0d22-b8e0-4d89-afa3-482d3867e471', 'ef31ee49-e843-463c-8ad3-6504c2292eb0', 'f1a1c541-4ac9-430e-9b6e-f70cd9e392e4', 'c716f032-12a8-4670-93e8-34b5db5c954d'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:18 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-d3173310-a04b-46af-ae6c-b47bbe29abc6 tempest-ProjectReaderTests-544844019 None] Delete snapshot completed successfully. Sep 05 05:20:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d3173310-a04b-46af-ae6c-b47bbe29abc6 tempest-ProjectReaderTests-544844019 None] Lock "cinder-502298ca-d713-4ab3-9ab1-67dc0b4c1934-delete_snapshot" released by "delete_snapshot" :: held 2.072s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-5cda93e6-d52a-4228-af94-532d0ae675df tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-00843320-0c8a-4363-926b-8a9a93110598-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-5cda93e6-d52a-4228-af94-532d0ae675df tempest-ProjectReaderTests-544844019 None] Lock "cinder-00843320-0c8a-4363-926b-8a9a93110598-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-5cda93e6-d52a-4228-af94-532d0ae675df tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-quobyte-00843320-0c8a-4363-926b-8a9a93110598" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-5cda93e6-d52a-4228-af94-532d0ae675df tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-00843320-0c8a-4363-926b-8a9a93110598" acquired by "delete_volume" :: waited 0.022s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf80e76-87de-42b6-82a5-3ab889113655]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5cda93e6-d52a-4228-af94-532d0ae675df tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:19 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598 Sep 05 05:20:19 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Flow 'volume_create_manager' (8137179b-1621-48dd-abff-b041996a027f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204c75ab-0083-46ac-938e-89191d93ad39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204c75ab-0083-46ac-938e-89191d93ad39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1833796941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa4921b6-e544-4953-8061-d159fb91ce3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb516afdca3f4d53a01e3815de2a52bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:19Z,use_quota=True,user_id='6b16bbd0620d41fa9958795beb0166fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4589ff-01d3-4420-95dd-01c2e04465ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4589ff-01d3-4420-95dd-01c2e04465ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44bcaf30-2983-4067-bf39-bb8470f2f0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44bcaf30-2983-4067-bf39-bb8470f2f0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa4921b6-e544-4953-8061-d159fb91ce3f', 'volume_name': 'volume-fa4921b6-e544-4953-8061-d159fb91ce3f', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5558eb6c-ad33-48ba-9a9a-529fee0b3a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5558eb6c-ad33-48ba-9a9a-529fee0b3a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:19 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f062074b-7914-49a7-b7eb-69046e249096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:19 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Volume fa4921b6-e544-4953-8061-d159fb91ce3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa4921b6-e544-4953-8061-d159fb91ce3f', 'volume_size': 1} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1833796941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa4921b6-e544-4953-8061-d159fb91ce3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb516afdca3f4d53a01e3815de2a52bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:19Z,use_quota=True,user_id='6b16bbd0620d41fa9958795beb0166fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Creating volume fa4921b6-e544-4953-8061-d159fb91ce3f {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:19 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5cda93e6-d52a-4228-af94-532d0ae675df tempest-ProjectReaderTests-544844019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598" returned: 0 in 0.581s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5cda93e6-d52a-4228-af94-532d0ae675df tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:19 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f 1073741824 Sep 05 05:20:19 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:19 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598 Sep 05 05:20:19 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:19 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5cda93e6-d52a-4228-af94-532d0ae675df tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00843320-0c8a-4363-926b-8a9a93110598" returned: 0 in 0.294s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:19 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-5cda93e6-d52a-4228-af94-532d0ae675df tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-00843320-0c8a-4363-926b-8a9a93110598" released by "delete_volume" :: held 0.972s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:20 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-5cda93e6-d52a-4228-af94-532d0ae675df tempest-ProjectReaderTests-544844019 None] Created reservations ['2075dec3-83e0-4faa-9191-356f96a0dbc0', '73cacb01-c7b0-4792-9aad-6f91acd1bce9', 'abdcb3a0-845b-4a97-9c36-58ad576179fc', 'a1f24e4f-6877-40a6-aac7-bae8ca2ce508'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5cda93e6-d52a-4228-af94-532d0ae675df tempest-ProjectReaderTests-544844019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5cda93e6-d52a-4228-af94-532d0ae675df tempest-ProjectReaderTests-544844019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5cda93e6-d52a-4228-af94-532d0ae675df tempest-ProjectReaderTests-544844019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5cda93e6-d52a-4228-af94-532d0ae675df tempest-ProjectReaderTests-544844019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5cda93e6-d52a-4228-af94-532d0ae675df tempest-ProjectReaderTests-544844019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5cda93e6-d52a-4228-af94-532d0ae675df tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:20 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f 1073741824" returned: 0 in 0.536s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:20 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:20 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:20 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f Sep 05 05:20:20 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:20 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5cda93e6-d52a-4228-af94-532d0ae675df tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.321s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:20 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-5cda93e6-d52a-4228-af94-532d0ae675df tempest-ProjectReaderTests-544844019 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:20 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-5cda93e6-d52a-4228-af94-532d0ae675df tempest-ProjectReaderTests-544844019 None] Deleted volume successfully. Sep 05 05:20:20 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-5cda93e6-d52a-4228-af94-532d0ae675df tempest-ProjectReaderTests-544844019 None] Lock "cinder-00843320-0c8a-4363-926b-8a9a93110598-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:20 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f" returned: 0 in 0.330s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f062074b-7914-49a7-b7eb-69046e249096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa4921b6-e544-4953-8061-d159fb91ce3f', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f38bc09-17e1-4dc9-9efb-343328e078bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:20 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Volume volume-fa4921b6-e544-4953-8061-d159fb91ce3f (fa4921b6-e544-4953-8061-d159fb91ce3f): created successfully Sep 05 05:20:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f38bc09-17e1-4dc9-9efb-343328e078bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:20 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Flow 'volume_create_manager' (8137179b-1621-48dd-abff-b041996a027f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:20 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ed6b6111-0777-4de2-a24e-3cdb22c36941 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Created volume successfully. Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Flow 'volume_create_manager' (3be1526b-3581-4cbd-9df2-329b744a3991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52491df6-97d1-406b-a333-2c71ac7d2428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52491df6-97d1-406b-a333-2c71ac7d2428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d4e0405-f26f-4d7f-a893-446c1e3df45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7396ce1f7db849fe8ea04faa00c10321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:21Z,use_quota=True,user_id='6e789dbd5f7a4ad188d28e1f67f06ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b89e74b-7922-4482-9f58-9e5aad7405c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b89e74b-7922-4482-9f58-9e5aad7405c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9861b9-ef9a-4912-91cf-c11c2c47a6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9861b9-ef9a-4912-91cf-c11c2c47a6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d4e0405-f26f-4d7f-a893-446c1e3df45f', 'volume_name': 'volume-0d4e0405-f26f-4d7f-a893-446c1e3df45f', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60380832-96ea-4d3d-b303-45a2534acbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60380832-96ea-4d3d-b303-45a2534acbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3242c0-45d6-4eae-8051-d218d5e38f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:21 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Volume 0d4e0405-f26f-4d7f-a893-446c1e3df45f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d4e0405-f26f-4d7f-a893-446c1e3df45f', 'volume_size': 1} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d4e0405-f26f-4d7f-a893-446c1e3df45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7396ce1f7db849fe8ea04faa00c10321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:21Z,use_quota=True,user_id='6e789dbd5f7a4ad188d28e1f67f06ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Creating volume 0d4e0405-f26f-4d7f-a893-446c1e3df45f {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:21 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d4e0405-f26f-4d7f-a893-446c1e3df45f 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:21 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d4e0405-f26f-4d7f-a893-446c1e3df45f 1073741824 Sep 05 05:20:21 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:21 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d4e0405-f26f-4d7f-a893-446c1e3df45f 1073741824" returned: 0 in 0.594s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Flow 'volume_create_manager' (5fe4ebd0-63d8-45bf-ae48-1c99d707458f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38bb733d-7d01-4a90-a460-e193dddcef10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38bb733d-7d01-4a90-a460-e193dddcef10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2096521497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddcd468ba4ee4f31ad43c9f153ba3f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:22Z,use_quota=True,user_id='5d90352309854303aa9a3d8d5110463e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b4991c-eca8-451d-99d9-6495a519a43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b4991c-eca8-451d-99d9-6495a519a43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23e3308-efdf-4e6c-8d0b-0e76eb8e8735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23e3308-efdf-4e6c-8d0b-0e76eb8e8735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052', 'volume_name': 'volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e72be1-ed51-4aae-b795-88c2ce90b353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e72be1-ed51-4aae-b795-88c2ce90b353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2ae0be-4171-4657-9c8e-61e22220b304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:21 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Volume 57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052', 'volume_size': 1} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d4e0405-f26f-4d7f-a893-446c1e3df45f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-df91c0d3-487b-4227-958d-ab9665ef8535 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:21 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d4e0405-f26f-4d7f-a893-446c1e3df45f Sep 05 05:20:21 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:22 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d4e0405-f26f-4d7f-a893-446c1e3df45f" returned: 0 in 0.267s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.286s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2096521497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddcd468ba4ee4f31ad43c9f153ba3f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:22Z,use_quota=True,user_id='5d90352309854303aa9a3d8d5110463e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Creating volume 57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:22 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3242c0-45d6-4eae-8051-d218d5e38f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d4e0405-f26f-4d7f-a893-446c1e3df45f', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:22 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052 1073741824 Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675acd9a-9202-4852-8de6-3d150d31a342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:22 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:22 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Volume volume-0d4e0405-f26f-4d7f-a893-446c1e3df45f (0d4e0405-f26f-4d7f-a893-446c1e3df45f): created successfully Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675acd9a-9202-4852-8de6-3d150d31a342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Flow 'volume_create_manager' (3be1526b-3581-4cbd-9df2-329b744a3991) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:22 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-d05831c7-3ecf-4c9d-9a9b-4bed814b0c12 tempest-CinderUnicodeTest-1712953756 None] Created volume successfully. Sep 05 05:20:22 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052 1073741824" returned: 0 in 0.445s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:22 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052 Sep 05 05:20:22 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:22 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052" returned: 0 in 0.264s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-df91c0d3-487b-4227-958d-ab9665ef8535 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.030s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-df91c0d3-487b-4227-958d-ab9665ef8535 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Creating offline snapshot e583f6d3-7620-4da0-8900-94d85bb01da6 of volume fa4921b6-e544-4953-8061-d159fb91ce3f {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2ae0be-4171-4657-9c8e-61e22220b304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e673fdb4-c596-4fec-a29f-7e7043d7848f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86a14e8-0b98-467d-bb27-e3a311714bc9]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-df91c0d3-487b-4227-958d-ab9665ef8535 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:23 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Volume volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052 (57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052): created successfully Sep 05 05:20:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e673fdb4-c596-4fec-a29f-7e7043d7848f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Flow 'volume_create_manager' (5fe4ebd0-63d8-45bf-ae48-1c99d707458f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:23 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ae2e95ed-7baf-4df3-88ef-0841d3e31381 tempest-ProjectReaderTests-544844019 None] Created volume successfully. Sep 05 05:20:23 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f Sep 05 05:20:23 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:23 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-df91c0d3-487b-4227-958d-ab9665ef8535 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f" returned: 0 in 0.408s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-df91c0d3-487b-4227-958d-ab9665ef8535 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.e583f6d3-7620-4da0-8900-94d85bb01da6 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:23 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.e583f6d3-7620-4da0-8900-94d85bb01da6 1G Sep 05 05:20:23 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:23 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Flow 'volume_create_manager' (e78ce26d-7195-40b2-8408-92a169d669a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa95d02-83d3-4e03-966d-55042197641c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa95d02-83d3-4e03-966d-55042197641c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1916898490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a0b227-02d0-4842-b887-e7b74962d4fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7396ce1f7db849fe8ea04faa00c10321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:24Z,use_quota=True,user_id='6e789dbd5f7a4ad188d28e1f67f06ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eede714-a666-4e38-94c3-ae547ead682d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eede714-a666-4e38-94c3-ae547ead682d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d39f10a3-d323-44a7-8e0a-856eaed47573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d39f10a3-d323-44a7-8e0a-856eaed47573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4a0b227-02d0-4842-b887-e7b74962d4fe', 'volume_name': 'volume-b4a0b227-02d0-4842-b887-e7b74962d4fe', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25412e9-b9c4-4450-bbaa-19ec97a67d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25412e9-b9c4-4450-bbaa-19ec97a67d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f7200a-c288-409a-aeb8-1b167f01de60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:23 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Volume b4a0b227-02d0-4842-b887-e7b74962d4fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4a0b227-02d0-4842-b887-e7b74962d4fe', 'volume_size': 1} Sep 05 05:20:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:23 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-df91c0d3-487b-4227-958d-ab9665ef8535 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.e583f6d3-7620-4da0-8900-94d85bb01da6 1G" returned: 0 in 0.525s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-df91c0d3-487b-4227-958d-ab9665ef8535 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa4921b6-e544-4953-8061-d159fb91ce3f -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.e583f6d3-7620-4da0-8900-94d85bb01da6 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:23 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa4921b6-e544-4953-8061-d159fb91ce3f -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.e583f6d3-7620-4da0-8900-94d85bb01da6 Sep 05 05:20:23 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9d3d7e80-97cf-45a3-9d5f-7c0f579f2f50 tempest-ProjectReaderTests-544844019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:24 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Flow 'volume_create_manager' (5d59f8b0-15ce-4ecb-b432-f677f2ff8c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26b16e0-1fd7-4107-8869-7cd8a57aeb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26b16e0-1fd7-4107-8869-7cd8a57aeb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1526544644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b2f2ff-3ebe-4a4c-b13e-076aace8d73a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c657235a3fda464cafe5a5f233b90991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:24Z,use_quota=True,user_id='27bab183b95b47bb92e8673e0ad0c0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:24 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2ac243-6e46-46db-9cae-af21ad4b5053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2ac243-6e46-46db-9cae-af21ad4b5053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d30545d4-0279-4c8b-8af1-de8d13225a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d30545d4-0279-4c8b-8af1-de8d13225a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73b2f2ff-3ebe-4a4c-b13e-076aace8d73a', 'volume_name': 'volume-73b2f2ff-3ebe-4a4c-b13e-076aace8d73a', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59a5ca21-6a17-4e9f-a418-8ad70b20c875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59a5ca21-6a17-4e9f-a418-8ad70b20c875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8987b1ee-2a7d-4943-aabd-7a07e0fbeb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:24 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Volume 73b2f2ff-3ebe-4a4c-b13e-076aace8d73a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73b2f2ff-3ebe-4a4c-b13e-076aace8d73a', 'volume_size': 1} Sep 05 05:20:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-df91c0d3-487b-4227-958d-ab9665ef8535 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa4921b6-e544-4953-8061-d159fb91ce3f -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.e583f6d3-7620-4da0-8900-94d85bb01da6" returned: 0 in 0.353s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:24 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-df91c0d3-487b-4227-958d-ab9665ef8535 tempest-CreateVolumesFromSnapshotTest-1241318939 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.e583f6d3-7620-4da0-8900-94d85bb01da6 is being set with open permissions: ugo+rw Sep 05 05:20:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-df91c0d3-487b-4227-958d-ab9665ef8535 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.e583f6d3-7620-4da0-8900-94d85bb01da6 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:24 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.e583f6d3-7620-4da0-8900-94d85bb01da6 Sep 05 05:20:24 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:24 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-df91c0d3-487b-4227-958d-ab9665ef8535 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.e583f6d3-7620-4da0-8900-94d85bb01da6" returned: 0 in 0.243s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-df91c0d3-487b-4227-958d-ab9665ef8535 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:24 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.info Sep 05 05:20:24 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:24 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-df91c0d3-487b-4227-958d-ab9665ef8535 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.info" returned: 0 in 0.258s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:24 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-df91c0d3-487b-4227-958d-ab9665ef8535 tempest-CreateVolumesFromSnapshotTest-1241318939 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.info is being set with open permissions: ugo+rw Sep 05 05:20:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-df91c0d3-487b-4227-958d-ab9665ef8535 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:24 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.info Sep 05 05:20:24 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:25 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-df91c0d3-487b-4227-958d-ab9665ef8535 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.info" returned: 0 in 0.245s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-df91c0d3-487b-4227-958d-ab9665ef8535 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.130s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.199s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1916898490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a0b227-02d0-4842-b887-e7b74962d4fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7396ce1f7db849fe8ea04faa00c10321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:24Z,use_quota=True,user_id='6e789dbd5f7a4ad188d28e1f67f06ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Creating volume b4a0b227-02d0-4842-b887-e7b74962d4fe {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:25 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:25 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe 1073741824 Sep 05 05:20:25 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:25 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-df91c0d3-487b-4227-958d-ab9665ef8535 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Create snapshot completed successfully Sep 05 05:20:25 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe 1073741824" returned: 0 in 0.406s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:25 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe Sep 05 05:20:25 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:25 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe" returned: 0 in 0.238s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9d3d7e80-97cf-45a3-9d5f-7c0f579f2f50 tempest-ProjectReaderTests-544844019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.582s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f7200a-c288-409a-aeb8-1b167f01de60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4a0b227-02d0-4842-b887-e7b74962d4fe', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f708154-be59-4c1f-9350-36f6326b816e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-9d3d7e80-97cf-45a3-9d5f-7c0f579f2f50 tempest-ProjectReaderTests-544844019 None] Creating offline snapshot da37f415-19f8-4ddf-b9cb-067de67c77ec of volume 57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:20:25 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Volume volume-b4a0b227-02d0-4842-b887-e7b74962d4fe (b4a0b227-02d0-4842-b887-e7b74962d4fe): created successfully Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f708154-be59-4c1f-9350-36f6326b816e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Flow 'volume_create_manager' (e78ce26d-7195-40b2-8408-92a169d669a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2346aa-ce54-44d3-ae7f-2585748c53cf]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9d3d7e80-97cf-45a3-9d5f-7c0f579f2f50 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:25 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-69e3a28f-fb77-4812-a93f-c28ff2261225 tempest-CinderUnicodeTest-1712953756 None] Created volume successfully. Sep 05 05:20:25 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052 Sep 05 05:20:25 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:26 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9d3d7e80-97cf-45a3-9d5f-7c0f579f2f50 tempest-ProjectReaderTests-544844019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052" returned: 0 in 0.368s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9d3d7e80-97cf-45a3-9d5f-7c0f579f2f50 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.da37f415-19f8-4ddf-b9cb-067de67c77ec 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:26 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.da37f415-19f8-4ddf-b9cb-067de67c77ec 1G Sep 05 05:20:26 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Flow 'volume_create_manager' (296c9ac8-1f00-484d-846f-48e04e2b8b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c3152a4-2bc2-4d39-b818-609a866de44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c3152a4-2bc2-4d39-b818-609a866de44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1377808789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63659a33-da35-4fe6-8124-58504de2df2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb516afdca3f4d53a01e3815de2a52bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:26Z,use_quota=True,user_id='6b16bbd0620d41fa9958795beb0166fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28bcdf55-23a8-4091-b2cc-520fa05e37e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28bcdf55-23a8-4091-b2cc-520fa05e37e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbba0645-31f0-4a31-8009-0684d5a2c27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbba0645-31f0-4a31-8009-0684d5a2c27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63659a33-da35-4fe6-8124-58504de2df2a', 'volume_name': 'volume-63659a33-da35-4fe6-8124-58504de2df2a', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eeb904a-22d1-4069-a980-f3f6f02f9ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eeb904a-22d1-4069-a980-f3f6f02f9ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c0e63e-9fc8-4ebb-9452-d8fef3d46ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:26 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Volume 63659a33-da35-4fe6-8124-58504de2df2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63659a33-da35-4fe6-8124-58504de2df2a', 'volume_size': 1} Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:26 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9d3d7e80-97cf-45a3-9d5f-7c0f579f2f50 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.da37f415-19f8-4ddf-b9cb-067de67c77ec 1G" returned: 0 in 0.451s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9d3d7e80-97cf-45a3-9d5f-7c0f579f2f50 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.da37f415-19f8-4ddf-b9cb-067de67c77ec {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:26 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.da37f415-19f8-4ddf-b9cb-067de67c77ec Sep 05 05:20:26 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Flow 'volume_create_manager' (c5344c8e-c11a-4493-98bb-d05b1ad00b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60d4f46-88cd-44c9-8f02-ee3020da04b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60d4f46-88cd-44c9-8f02-ee3020da04b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-877919796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72627ce5-2d29-4dc2-a149-05add58bf648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb516afdca3f4d53a01e3815de2a52bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:27Z,use_quota=True,user_id='6b16bbd0620d41fa9958795beb0166fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a6f7fb-1af2-4410-a709-f4ce06102c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a6f7fb-1af2-4410-a709-f4ce06102c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2eaee56-4147-4c93-bc44-765eeb94e322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2eaee56-4147-4c93-bc44-765eeb94e322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72627ce5-2d29-4dc2-a149-05add58bf648', 'volume_name': 'volume-72627ce5-2d29-4dc2-a149-05add58bf648', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764b342f-4860-451d-8602-9f9853b2caa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764b342f-4860-451d-8602-9f9853b2caa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:26 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89bd3b36-c36b-431b-a1ab-9b48513faccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:26 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Volume 72627ce5-2d29-4dc2-a149-05add58bf648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72627ce5-2d29-4dc2-a149-05add58bf648', 'volume_size': 1} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9d3d7e80-97cf-45a3-9d5f-7c0f579f2f50 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.da37f415-19f8-4ddf-b9cb-067de67c77ec" returned: 0 in 0.353s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:27 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-9d3d7e80-97cf-45a3-9d5f-7c0f579f2f50 tempest-ProjectReaderTests-544844019 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.da37f415-19f8-4ddf-b9cb-067de67c77ec is being set with open permissions: ugo+rw Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9d3d7e80-97cf-45a3-9d5f-7c0f579f2f50 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.da37f415-19f8-4ddf-b9cb-067de67c77ec {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:27 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.da37f415-19f8-4ddf-b9cb-067de67c77ec Sep 05 05:20:27 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:27 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9d3d7e80-97cf-45a3-9d5f-7c0f579f2f50 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.da37f415-19f8-4ddf-b9cb-067de67c77ec" returned: 0 in 0.289s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9d3d7e80-97cf-45a3-9d5f-7c0f579f2f50 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:27 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.info Sep 05 05:20:27 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Flow 'volume_create_manager' (34e6fbff-7b27-411c-9b15-b6c51b027f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ca6563-47e6-4a5c-9a49-33f64d2a4279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0da4b945-7682-4aaf-8d56-b368092e3d9a tempest-CinderUnicodeTest-1712953756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ca6563-47e6-4a5c-9a49-33f64d2a4279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2066195776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f90f5c6-7523-4945-b04c-d75dc8759ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb516afdca3f4d53a01e3815de2a52bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:27Z,use_quota=True,user_id='6b16bbd0620d41fa9958795beb0166fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c478c5cb-a25d-4c54-bb79-6c59d9c5841c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c478c5cb-a25d-4c54-bb79-6c59d9c5841c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac3753e-6ad4-4e86-8557-ad841d2c2b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac3753e-6ad4-4e86-8557-ad841d2c2b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f90f5c6-7523-4945-b04c-d75dc8759ebf', 'volume_name': 'volume-9f90f5c6-7523-4945-b04c-d75dc8759ebf', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1feb992e-e627-4823-8429-49ef45469f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1feb992e-e627-4823-8429-49ef45469f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d24710-b1da-4004-b59f-21db3125fad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:27 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Volume 9f90f5c6-7523-4945-b04c-d75dc8759ebf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f90f5c6-7523-4945-b04c-d75dc8759ebf', 'volume_size': 1} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:27 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9d3d7e80-97cf-45a3-9d5f-7c0f579f2f50 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.info" returned: 0 in 0.337s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:27 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-9d3d7e80-97cf-45a3-9d5f-7c0f579f2f50 tempest-ProjectReaderTests-544844019 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.info is being set with open permissions: ugo+rw Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9d3d7e80-97cf-45a3-9d5f-7c0f579f2f50 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:27 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.info Sep 05 05:20:27 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Flow 'volume_create_manager' (7ce893d5-e471-42d5-b211-553e1b3a1ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2813afae-28b0-412e-a86a-95af0ca1d5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2813afae-28b0-412e-a86a-95af0ca1d5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-30113114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23980ea-e85e-4769-b32a-a0f5c32efa4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb516afdca3f4d53a01e3815de2a52bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:28Z,use_quota=True,user_id='6b16bbd0620d41fa9958795beb0166fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10007d97-f465-4b33-8484-8e7f14faca87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10007d97-f465-4b33-8484-8e7f14faca87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7cd370-47eb-4add-a434-16480acecb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7cd370-47eb-4add-a434-16480acecb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f23980ea-e85e-4769-b32a-a0f5c32efa4f', 'volume_name': 'volume-f23980ea-e85e-4769-b32a-a0f5c32efa4f', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acab53ea-513d-4878-8c89-ad7020265b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acab53ea-513d-4878-8c89-ad7020265b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10966b98-304b-44b7-acb6-b3f1b98aa4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:27 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Volume f23980ea-e85e-4769-b32a-a0f5c32efa4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f23980ea-e85e-4769-b32a-a0f5c32efa4f', 'volume_size': 1} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:27 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9d3d7e80-97cf-45a3-9d5f-7c0f579f2f50 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.info" returned: 0 in 0.288s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9d3d7e80-97cf-45a3-9d5f-7c0f579f2f50 tempest-ProjectReaderTests-544844019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.201s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.698s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1526544644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b2f2ff-3ebe-4a4c-b13e-076aace8d73a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c657235a3fda464cafe5a5f233b90991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:24Z,use_quota=True,user_id='27bab183b95b47bb92e8673e0ad0c0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Creating volume 73b2f2ff-3ebe-4a4c-b13e-076aace8d73a {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:27 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-73b2f2ff-3ebe-4a4c-b13e-076aace8d73a 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:28 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-73b2f2ff-3ebe-4a4c-b13e-076aace8d73a 1073741824 Sep 05 05:20:28 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:28 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-9d3d7e80-97cf-45a3-9d5f-7c0f579f2f50 tempest-ProjectReaderTests-544844019 None] Create snapshot completed successfully Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Flow 'volume_create_manager' (710b1f99-3f09-4a15-996b-309bfe5bce67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28cb8c6e-1ab7-4e83-8daf-5ea949419bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1f8e00cd-19c2-4ee2-9d9e-de9b0e5addcb tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-da37f415-19f8-4ddf-b9cb-067de67c77ec-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28cb8c6e-1ab7-4e83-8daf-5ea949419bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1188903278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebb3129d-3ae6-4472-934d-bf1a883f3e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb516afdca3f4d53a01e3815de2a52bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:28Z,use_quota=True,user_id='6b16bbd0620d41fa9958795beb0166fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e4de9e3-5a26-4787-82b6-a96f61fde3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e4de9e3-5a26-4787-82b6-a96f61fde3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2041f632-b10c-45b3-a749-76840332e233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2041f632-b10c-45b3-a749-76840332e233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebb3129d-3ae6-4472-934d-bf1a883f3e01', 'volume_name': 'volume-ebb3129d-3ae6-4472-934d-bf1a883f3e01', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94edcf6f-e31b-4ae1-ad86-b30bf2fe7f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94edcf6f-e31b-4ae1-ad86-b30bf2fe7f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03889ed-2ec0-454a-8046-56aba480073e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:28 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Volume ebb3129d-3ae6-4472-934d-bf1a883f3e01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebb3129d-3ae6-4472-934d-bf1a883f3e01', 'volume_size': 1} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1f8e00cd-19c2-4ee2-9d9e-de9b0e5addcb tempest-ProjectReaderTests-544844019 None] Lock "cinder-da37f415-19f8-4ddf-b9cb-067de67c77ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1f8e00cd-19c2-4ee2-9d9e-de9b0e5addcb tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-quobyte-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1f8e00cd-19c2-4ee2-9d9e-de9b0e5addcb tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052" acquired by "delete_snapshot" :: waited 0.014s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1f8e00cd-19c2-4ee2-9d9e-de9b0e5addcb tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-quobyte-da37f415-19f8-4ddf-b9cb-067de67c77ec" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1f8e00cd-19c2-4ee2-9d9e-de9b0e5addcb tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-da37f415-19f8-4ddf-b9cb-067de67c77ec" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-1f8e00cd-19c2-4ee2-9d9e-de9b0e5addcb tempest-ProjectReaderTests-544844019 None] Deleting offline snapshot da37f415-19f8-4ddf-b9cb-067de67c77ec of volume 57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-1f8e00cd-19c2-4ee2-9d9e-de9b0e5addcb tempest-ProjectReaderTests-544844019 None] snapshot_file for this snap is: volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.da37f415-19f8-4ddf-b9cb-067de67c77ec {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f58ab4a-4948-4471-b693-f94742774fe1]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f8e00cd-19c2-4ee2-9d9e-de9b0e5addcb tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.da37f415-19f8-4ddf-b9cb-067de67c77ec {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:28 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-73b2f2ff-3ebe-4a4c-b13e-076aace8d73a 1073741824" returned: 0 in 0.482s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-73b2f2ff-3ebe-4a4c-b13e-076aace8d73a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:28 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-73b2f2ff-3ebe-4a4c-b13e-076aace8d73a Sep 05 05:20:28 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:28 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.da37f415-19f8-4ddf-b9cb-067de67c77ec Sep 05 05:20:28 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:28 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-73b2f2ff-3ebe-4a4c-b13e-076aace8d73a" returned: 0 in 0.250s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.141s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1377808789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63659a33-da35-4fe6-8124-58504de2df2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb516afdca3f4d53a01e3815de2a52bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:26Z,use_quota=True,user_id='6b16bbd0620d41fa9958795beb0166fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Creating volume 63659a33-da35-4fe6-8124-58504de2df2a {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:28 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63659a33-da35-4fe6-8124-58504de2df2a 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8987b1ee-2a7d-4943-aabd-7a07e0fbeb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73b2f2ff-3ebe-4a4c-b13e-076aace8d73a', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:28 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63659a33-da35-4fe6-8124-58504de2df2a 1073741824 Sep 05 05:20:28 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80b99c6-0b82-4bd3-8be2-a53478d60fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:28 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f8e00cd-19c2-4ee2-9d9e-de9b0e5addcb tempest-ProjectReaderTests-544844019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.da37f415-19f8-4ddf-b9cb-067de67c77ec" returned: 0 in 0.373s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-1f8e00cd-19c2-4ee2-9d9e-de9b0e5addcb tempest-ProjectReaderTests-544844019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:20:28 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Volume volume-73b2f2ff-3ebe-4a4c-b13e-076aace8d73a (73b2f2ff-3ebe-4a4c-b13e-076aace8d73a): created successfully Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80b99c6-0b82-4bd3-8be2-a53478d60fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Flow 'volume_create_manager' (5d59f8b0-15ce-4ecb-b432-f677f2ff8c02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb75efc-88c4-4d44-99d4-c28f90344481]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f8e00cd-19c2-4ee2-9d9e-de9b0e5addcb tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:28 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-98a42091-6277-4ae7-a14c-e99aa243851d tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Created volume successfully. Sep 05 05:20:28 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052 Sep 05 05:20:28 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:29 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63659a33-da35-4fe6-8124-58504de2df2a 1073741824" returned: 0 in 0.412s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63659a33-da35-4fe6-8124-58504de2df2a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:29 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63659a33-da35-4fe6-8124-58504de2df2a Sep 05 05:20:29 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:29 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f8e00cd-19c2-4ee2-9d9e-de9b0e5addcb tempest-ProjectReaderTests-544844019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052" returned: 0 in 0.388s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f8e00cd-19c2-4ee2-9d9e-de9b0e5addcb tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.da37f415-19f8-4ddf-b9cb-067de67c77ec {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:29 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.da37f415-19f8-4ddf-b9cb-067de67c77ec Sep 05 05:20:29 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:29 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63659a33-da35-4fe6-8124-58504de2df2a" returned: 0 in 0.259s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.477s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-877919796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72627ce5-2d29-4dc2-a149-05add58bf648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb516afdca3f4d53a01e3815de2a52bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:27Z,use_quota=True,user_id='6b16bbd0620d41fa9958795beb0166fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Creating volume 72627ce5-2d29-4dc2-a149-05add58bf648 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:29 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-72627ce5-2d29-4dc2-a149-05add58bf648 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:29 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-72627ce5-2d29-4dc2-a149-05add58bf648 1073741824 Sep 05 05:20:29 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c0e63e-9fc8-4ebb-9452-d8fef3d46ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63659a33-da35-4fe6-8124-58504de2df2a', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6eb18d5-558c-4d49-96f0-e06131490bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:29 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Volume volume-63659a33-da35-4fe6-8124-58504de2df2a (63659a33-da35-4fe6-8124-58504de2df2a): created successfully Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6eb18d5-558c-4d49-96f0-e06131490bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Flow 'volume_create_manager' (296c9ac8-1f00-484d-846f-48e04e2b8b3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:29 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-37f69ab2-3447-46a8-b966-0230a41f54b3 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Created volume successfully. Sep 05 05:20:29 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f8e00cd-19c2-4ee2-9d9e-de9b0e5addcb tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.da37f415-19f8-4ddf-b9cb-067de67c77ec" returned: 0 in 0.465s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f8e00cd-19c2-4ee2-9d9e-de9b0e5addcb tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.da37f415-19f8-4ddf-b9cb-067de67c77ec {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:29 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.da37f415-19f8-4ddf-b9cb-067de67c77ec Sep 05 05:20:29 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:29 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f8e00cd-19c2-4ee2-9d9e-de9b0e5addcb tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052.da37f415-19f8-4ddf-b9cb-067de67c77ec" returned: 0 in 0.281s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:30 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-72627ce5-2d29-4dc2-a149-05add58bf648 1073741824" returned: 0 in 0.551s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1f8e00cd-19c2-4ee2-9d9e-de9b0e5addcb tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-da37f415-19f8-4ddf-b9cb-067de67c77ec" released by "_delete_snapshot" :: held 1.646s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1f8e00cd-19c2-4ee2-9d9e-de9b0e5addcb tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052" released by "delete_snapshot" :: held 1.673s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Flow 'volume_create_manager' (9d98f696-cb82-49f7-83a8-11ef16a1a63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e7bcdd7-17be-4457-8115-ab806f12efbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-72627ce5-2d29-4dc2-a149-05add58bf648 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e7bcdd7-17be-4457-8115-ab806f12efbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-736616709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ff6670-9e0e-46ff-9791-82e564022495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c657235a3fda464cafe5a5f233b90991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:30Z,use_quota=True,user_id='27bab183b95b47bb92e8673e0ad0c0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d2f064-c6fe-418c-8b24-71d29d1e82c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:30 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-72627ce5-2d29-4dc2-a149-05add58bf648 Sep 05 05:20:30 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d2f064-c6fe-418c-8b24-71d29d1e82c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9330fea-dfac-4739-bdf8-06fda4e2e9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9330fea-dfac-4739-bdf8-06fda4e2e9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77ff6670-9e0e-46ff-9791-82e564022495', 'volume_name': 'volume-77ff6670-9e0e-46ff-9791-82e564022495', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7745080e-1d2f-4f44-9698-a83e321ccc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7745080e-1d2f-4f44-9698-a83e321ccc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (466dcf36-6272-433f-8061-e7538f96efa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:30 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Volume 77ff6670-9e0e-46ff-9791-82e564022495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77ff6670-9e0e-46ff-9791-82e564022495', 'volume_size': 1} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-1f8e00cd-19c2-4ee2-9d9e-de9b0e5addcb tempest-ProjectReaderTests-544844019 None] Created reservations ['69297968-7512-4c0c-89f1-2d5a5e05a4a4', 'c60818a0-169b-4d5e-86cd-e4161abfc8aa', 'b9182ee2-a1c5-46b2-a01b-a7f2fa96261d', 'b6ecb5f5-f5cd-4399-afad-344df90a54ce'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:30 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-1f8e00cd-19c2-4ee2-9d9e-de9b0e5addcb tempest-ProjectReaderTests-544844019 None] Delete snapshot completed successfully. Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1f8e00cd-19c2-4ee2-9d9e-de9b0e5addcb tempest-ProjectReaderTests-544844019 None] Lock "cinder-da37f415-19f8-4ddf-b9cb-067de67c77ec-delete_snapshot" released by "delete_snapshot" :: held 2.017s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-72627ce5-2d29-4dc2-a149-05add58bf648" returned: 0 in 0.326s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0da4b945-7682-4aaf-8d56-b368092e3d9a tempest-CinderUnicodeTest-1712953756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.964s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:30 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89bd3b36-c36b-431b-a1ab-9b48513faccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72627ce5-2d29-4dc2-a149-05add58bf648', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6cf812e-faec-4189-8e06-acde855f2c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-0da4b945-7682-4aaf-8d56-b368092e3d9a tempest-CinderUnicodeTest-1712953756 None] Creating offline snapshot d770372a-9fb2-44d2-862f-a44e78be23ed of volume b4a0b227-02d0-4842-b887-e7b74962d4fe {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:20:30 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Volume volume-72627ce5-2d29-4dc2-a149-05add58bf648 (72627ce5-2d29-4dc2-a149-05add58bf648): created successfully Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6cf812e-faec-4189-8e06-acde855f2c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Flow 'volume_create_manager' (c5344c8e-c11a-4493-98bb-d05b1ad00b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-270d000a-4313-4768-96c6-b34d1097a30f tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[513e09ae-8689-4ba3-bf6b-8958c534f986]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0da4b945-7682-4aaf-8d56-b368092e3d9a tempest-CinderUnicodeTest-1712953756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:30 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-8dfdd384-e7ab-4074-8bdb-39a8f57958f1 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Created volume successfully. Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-270d000a-4313-4768-96c6-b34d1097a30f tempest-ProjectReaderTests-544844019 None] Lock "cinder-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Flow 'volume_create_manager' (d9fe0422-a3f3-4572-af92-d110b0158f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:30 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe Sep 05 05:20:30 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c125ae-8ef1-43a2-a81b-c7b6da33a780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c125ae-8ef1-43a2-a81b-c7b6da33a780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1481470770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e865d2f8-4c05-45d1-a275-5d5e30ea4c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c657235a3fda464cafe5a5f233b90991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:31Z,use_quota=True,user_id='27bab183b95b47bb92e8673e0ad0c0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84063056-dfa0-4e8b-ac3a-3db2f97b9101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84063056-dfa0-4e8b-ac3a-3db2f97b9101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74785680-fc5a-41b2-ae7c-44a3dae64f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74785680-fc5a-41b2-ae7c-44a3dae64f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e865d2f8-4c05-45d1-a275-5d5e30ea4c53', 'volume_name': 'volume-e865d2f8-4c05-45d1-a275-5d5e30ea4c53', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb0a852-fdc2-4eef-a6fb-a67440d192eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb0a852-fdc2-4eef-a6fb-a67440d192eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb44ffb-439d-44de-87bf-cb7f81d42d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:30 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Volume e865d2f8-4c05-45d1-a275-5d5e30ea4c53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e865d2f8-4c05-45d1-a275-5d5e30ea4c53', 'volume_size': 1} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-270d000a-4313-4768-96c6-b34d1097a30f tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-quobyte-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Flow 'volume_create_manager' (450160fa-f341-44c0-aecc-d3f1c2d4e5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8726040-049b-4c45-b81d-9500fc4035a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-270d000a-4313-4768-96c6-b34d1097a30f tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052" acquired by "delete_volume" :: waited 0.078s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[63412c91-8afe-49c7-bf52-da5e30b9d102]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-270d000a-4313-4768-96c6-b34d1097a30f tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8726040-049b-4c45-b81d-9500fc4035a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-237439626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cba6322-db19-4626-b16c-1ade64917ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c657235a3fda464cafe5a5f233b90991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:31Z,use_quota=True,user_id='27bab183b95b47bb92e8673e0ad0c0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0733fb2d-8939-4f67-a90b-20347c3f6c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0733fb2d-8939-4f67-a90b-20347c3f6c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6dce73b-9b06-4e62-b945-f9ba8b165388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6dce73b-9b06-4e62-b945-f9ba8b165388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cba6322-db19-4626-b16c-1ade64917ff0', 'volume_name': 'volume-1cba6322-db19-4626-b16c-1ade64917ff0', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e2e672-febf-456a-8b2f-e40bfca81d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e2e672-febf-456a-8b2f-e40bfca81d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d48354d-77c1-4c29-9b7d-fb9be48291f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:31 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Volume 1cba6322-db19-4626-b16c-1ade64917ff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cba6322-db19-4626-b16c-1ade64917ff0', 'volume_size': 1} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:31 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0da4b945-7682-4aaf-8d56-b368092e3d9a tempest-CinderUnicodeTest-1712953756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe" returned: 0 in 0.615s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0da4b945-7682-4aaf-8d56-b368092e3d9a tempest-CinderUnicodeTest-1712953756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.d770372a-9fb2-44d2-862f-a44e78be23ed 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:31 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052 Sep 05 05:20:31 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.d770372a-9fb2-44d2-862f-a44e78be23ed 1G Sep 05 05:20:31 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:31 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Flow 'volume_create_manager' (d31c37c0-eeae-4aab-8625-fb570669abe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e159ffb-9635-435d-8d45-4da443c232b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e159ffb-9635-435d-8d45-4da443c232b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1889909452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b993874b-3d42-4f53-bd34-9a95c27a2d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c657235a3fda464cafe5a5f233b90991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:31Z,use_quota=True,user_id='27bab183b95b47bb92e8673e0ad0c0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d1206a-851f-4190-a5bf-14726a39a940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d1206a-851f-4190-a5bf-14726a39a940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23de817a-6108-4e11-ba53-3f09e0798909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23de817a-6108-4e11-ba53-3f09e0798909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b993874b-3d42-4f53-bd34-9a95c27a2d75', 'volume_name': 'volume-b993874b-3d42-4f53-bd34-9a95c27a2d75', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3a2660-bc6e-4c8f-9317-9c67ec0406c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3a2660-bc6e-4c8f-9317-9c67ec0406c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614ab664-06ed-438d-9721-4e2b2dd80a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:31 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Volume b993874b-3d42-4f53-bd34-9a95c27a2d75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b993874b-3d42-4f53-bd34-9a95c27a2d75', 'volume_size': 1} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:31 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-270d000a-4313-4768-96c6-b34d1097a30f tempest-ProjectReaderTests-544844019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052" returned: 0 in 0.506s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-270d000a-4313-4768-96c6-b34d1097a30f tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:31 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052 Sep 05 05:20:31 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:31 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Flow 'volume_create_manager' (64e08d69-c6a4-42ec-b805-515430181141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258891c4-88b6-4a47-8fe9-19750e2f0963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0da4b945-7682-4aaf-8d56-b368092e3d9a tempest-CinderUnicodeTest-1712953756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.d770372a-9fb2-44d2-862f-a44e78be23ed 1G" returned: 0 in 0.545s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0da4b945-7682-4aaf-8d56-b368092e3d9a tempest-CinderUnicodeTest-1712953756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4a0b227-02d0-4842-b887-e7b74962d4fe -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.d770372a-9fb2-44d2-862f-a44e78be23ed {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258891c4-88b6-4a47-8fe9-19750e2f0963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1891498508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac71f93a-fcb9-43ec-81ef-91b36ac8b7da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c657235a3fda464cafe5a5f233b90991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:32Z,use_quota=True,user_id='27bab183b95b47bb92e8673e0ad0c0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:31 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4a0b227-02d0-4842-b887-e7b74962d4fe -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.d770372a-9fb2-44d2-862f-a44e78be23ed Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a23d3d-3ace-4b69-a913-19355cc48bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:31 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a23d3d-3ace-4b69-a913-19355cc48bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2534c5-f650-4c4a-8574-c1ea2d971486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2534c5-f650-4c4a-8574-c1ea2d971486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac71f93a-fcb9-43ec-81ef-91b36ac8b7da', 'volume_name': 'volume-ac71f93a-fcb9-43ec-81ef-91b36ac8b7da', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0fb98fb-29da-4a41-92eb-aa6a68fe43e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0fb98fb-29da-4a41-92eb-aa6a68fe43e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19945a6c-1be5-4e44-a34c-c81b20dbc294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:31 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Volume ac71f93a-fcb9-43ec-81ef-91b36ac8b7da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac71f93a-fcb9-43ec-81ef-91b36ac8b7da', 'volume_size': 1} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:31 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-270d000a-4313-4768-96c6-b34d1097a30f tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052" returned: 0 in 0.246s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-270d000a-4313-4768-96c6-b34d1097a30f tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052" released by "delete_volume" :: held 0.827s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-270d000a-4313-4768-96c6-b34d1097a30f tempest-ProjectReaderTests-544844019 None] Created reservations ['cac0a1b9-3b5f-4c43-81b6-1d2dc1507d5e', 'eaa861b6-4c9f-4d92-8a12-3580cd2f22b0', '44273c05-a1df-4632-8637-1e2f33946107', 'e9722cfd-e168-41a5-9f30-2399c01f62e5'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-270d000a-4313-4768-96c6-b34d1097a30f tempest-ProjectReaderTests-544844019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-270d000a-4313-4768-96c6-b34d1097a30f tempest-ProjectReaderTests-544844019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-270d000a-4313-4768-96c6-b34d1097a30f tempest-ProjectReaderTests-544844019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-270d000a-4313-4768-96c6-b34d1097a30f tempest-ProjectReaderTests-544844019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-270d000a-4313-4768-96c6-b34d1097a30f tempest-ProjectReaderTests-544844019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-270d000a-4313-4768-96c6-b34d1097a30f tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:31 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:31 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:32 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0da4b945-7682-4aaf-8d56-b368092e3d9a tempest-CinderUnicodeTest-1712953756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4a0b227-02d0-4842-b887-e7b74962d4fe -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.d770372a-9fb2-44d2-862f-a44e78be23ed" returned: 0 in 0.317s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:32 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-0da4b945-7682-4aaf-8d56-b368092e3d9a tempest-CinderUnicodeTest-1712953756 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.d770372a-9fb2-44d2-862f-a44e78be23ed is being set with open permissions: ugo+rw Sep 05 05:20:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0da4b945-7682-4aaf-8d56-b368092e3d9a tempest-CinderUnicodeTest-1712953756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.d770372a-9fb2-44d2-862f-a44e78be23ed {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:32 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.d770372a-9fb2-44d2-862f-a44e78be23ed Sep 05 05:20:32 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:32 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-270d000a-4313-4768-96c6-b34d1097a30f tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.254s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:32 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-270d000a-4313-4768-96c6-b34d1097a30f tempest-ProjectReaderTests-544844019 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:32 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-270d000a-4313-4768-96c6-b34d1097a30f tempest-ProjectReaderTests-544844019 None] Deleted volume successfully. Sep 05 05:20:32 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-270d000a-4313-4768-96c6-b34d1097a30f tempest-ProjectReaderTests-544844019 None] Lock "cinder-57fc9a5e-5a17-4d86-8ae4-fbc9af1cf052-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:32 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0da4b945-7682-4aaf-8d56-b368092e3d9a tempest-CinderUnicodeTest-1712953756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.d770372a-9fb2-44d2-862f-a44e78be23ed" returned: 0 in 0.256s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0da4b945-7682-4aaf-8d56-b368092e3d9a tempest-CinderUnicodeTest-1712953756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:32 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.info Sep 05 05:20:32 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:32 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0da4b945-7682-4aaf-8d56-b368092e3d9a tempest-CinderUnicodeTest-1712953756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.info" returned: 0 in 0.276s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:32 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-0da4b945-7682-4aaf-8d56-b368092e3d9a tempest-CinderUnicodeTest-1712953756 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.info is being set with open permissions: ugo+rw Sep 05 05:20:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0da4b945-7682-4aaf-8d56-b368092e3d9a tempest-CinderUnicodeTest-1712953756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:32 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.info Sep 05 05:20:32 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:32 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0da4b945-7682-4aaf-8d56-b368092e3d9a tempest-CinderUnicodeTest-1712953756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.info" returned: 0 in 0.251s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0da4b945-7682-4aaf-8d56-b368092e3d9a tempest-CinderUnicodeTest-1712953756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.402s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.311s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:32 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2066195776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f90f5c6-7523-4945-b04c-d75dc8759ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb516afdca3f4d53a01e3815de2a52bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:27Z,use_quota=True,user_id='6b16bbd0620d41fa9958795beb0166fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:32 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Creating volume 9f90f5c6-7523-4945-b04c-d75dc8759ebf {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:32 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:32 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:32 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:32 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9f90f5c6-7523-4945-b04c-d75dc8759ebf 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:32 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9f90f5c6-7523-4945-b04c-d75dc8759ebf 1073741824 Sep 05 05:20:32 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:32 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-0da4b945-7682-4aaf-8d56-b368092e3d9a tempest-CinderUnicodeTest-1712953756 None] Create snapshot completed successfully Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Flow 'volume_create_manager' (5602699b-cacb-4bdb-8255-551187f507c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e4acfa-60ca-4be4-a8c7-9f5aba4a27de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e4acfa-60ca-4be4-a8c7-9f5aba4a27de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1374280265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=551b1eba-f002-453a-ab81-980348784245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddcd468ba4ee4f31ad43c9f153ba3f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:33Z,use_quota=True,user_id='5d90352309854303aa9a3d8d5110463e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc6715c8-27a8-4268-9038-55dce4ffa5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc6715c8-27a8-4268-9038-55dce4ffa5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:33 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e440e86a-4434-46f2-887e-e7e0ca1bf597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e440e86a-4434-46f2-887e-e7e0ca1bf597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '551b1eba-f002-453a-ab81-980348784245', 'volume_name': 'volume-551b1eba-f002-453a-ab81-980348784245', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c56aa48d-fd06-4c40-9c74-61f5626cb8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c56aa48d-fd06-4c40-9c74-61f5626cb8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac88171-337e-472e-9929-45d05519263e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:33 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Volume 551b1eba-f002-453a-ab81-980348784245: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-551b1eba-f002-453a-ab81-980348784245', 'volume_size': 1} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9f90f5c6-7523-4945-b04c-d75dc8759ebf 1073741824" returned: 0 in 0.444s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9f90f5c6-7523-4945-b04c-d75dc8759ebf {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:33 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9f90f5c6-7523-4945-b04c-d75dc8759ebf Sep 05 05:20:33 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:33 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9f90f5c6-7523-4945-b04c-d75dc8759ebf" returned: 0 in 0.260s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.793s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-30113114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23980ea-e85e-4769-b32a-a0f5c32efa4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb516afdca3f4d53a01e3815de2a52bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:28Z,use_quota=True,user_id='6b16bbd0620d41fa9958795beb0166fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Creating volume f23980ea-e85e-4769-b32a-a0f5c32efa4f {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:33 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f23980ea-e85e-4769-b32a-a0f5c32efa4f 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-640c4f80-613e-48e3-a508-8377a25ea625 tempest-CinderUnicodeTest-1712953756 None] Acquiring lock "cinder-d770372a-9fb2-44d2-862f-a44e78be23ed-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:33 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f23980ea-e85e-4769-b32a-a0f5c32efa4f 1073741824 Sep 05 05:20:33 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d24710-b1da-4004-b59f-21db3125fad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f90f5c6-7523-4945-b04c-d75dc8759ebf', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c305c8-ecb6-40fa-8a13-e1153d9ec712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-640c4f80-613e-48e3-a508-8377a25ea625 tempest-CinderUnicodeTest-1712953756 None] Lock "cinder-d770372a-9fb2-44d2-862f-a44e78be23ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-640c4f80-613e-48e3-a508-8377a25ea625 tempest-CinderUnicodeTest-1712953756 None] Acquiring lock "cinder-quobyte-b4a0b227-02d0-4842-b887-e7b74962d4fe" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:33 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Volume volume-9f90f5c6-7523-4945-b04c-d75dc8759ebf (9f90f5c6-7523-4945-b04c-d75dc8759ebf): created successfully Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c305c8-ecb6-40fa-8a13-e1153d9ec712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Flow 'volume_create_manager' (34e6fbff-7b27-411c-9b15-b6c51b027f5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-640c4f80-613e-48e3-a508-8377a25ea625 tempest-CinderUnicodeTest-1712953756 None] Lock "cinder-quobyte-b4a0b227-02d0-4842-b887-e7b74962d4fe" acquired by "delete_snapshot" :: waited 0.035s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-640c4f80-613e-48e3-a508-8377a25ea625 tempest-CinderUnicodeTest-1712953756 None] Acquiring lock "cinder-quobyte-d770372a-9fb2-44d2-862f-a44e78be23ed" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:33 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-0b45b9eb-7877-478c-8f19-415f2c8a5d91 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Created volume successfully. Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-640c4f80-613e-48e3-a508-8377a25ea625 tempest-CinderUnicodeTest-1712953756 None] Lock "cinder-quobyte-d770372a-9fb2-44d2-862f-a44e78be23ed" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-640c4f80-613e-48e3-a508-8377a25ea625 tempest-CinderUnicodeTest-1712953756 None] Deleting offline snapshot d770372a-9fb2-44d2-862f-a44e78be23ed of volume b4a0b227-02d0-4842-b887-e7b74962d4fe {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-640c4f80-613e-48e3-a508-8377a25ea625 tempest-CinderUnicodeTest-1712953756 None] snapshot_file for this snap is: volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.d770372a-9fb2-44d2-862f-a44e78be23ed {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[878ba2f0-9064-446d-88db-1de756d3a137]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-640c4f80-613e-48e3-a508-8377a25ea625 tempest-CinderUnicodeTest-1712953756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.d770372a-9fb2-44d2-862f-a44e78be23ed {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:33 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.d770372a-9fb2-44d2-862f-a44e78be23ed Sep 05 05:20:33 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:34 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f23980ea-e85e-4769-b32a-a0f5c32efa4f 1073741824" returned: 0 in 0.437s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f23980ea-e85e-4769-b32a-a0f5c32efa4f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:34 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f23980ea-e85e-4769-b32a-a0f5c32efa4f Sep 05 05:20:34 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:34 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-640c4f80-613e-48e3-a508-8377a25ea625 tempest-CinderUnicodeTest-1712953756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.d770372a-9fb2-44d2-862f-a44e78be23ed" returned: 0 in 0.386s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-640c4f80-613e-48e3-a508-8377a25ea625 tempest-CinderUnicodeTest-1712953756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4a0b227-02d0-4842-b887-e7b74962d4fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[516a76c5-eb4c-4cb2-8ef5-704229a32d7d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-640c4f80-613e-48e3-a508-8377a25ea625 tempest-CinderUnicodeTest-1712953756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:34 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe Sep 05 05:20:34 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:34 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f23980ea-e85e-4769-b32a-a0f5c32efa4f" returned: 0 in 0.269s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.995s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1188903278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebb3129d-3ae6-4472-934d-bf1a883f3e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb516afdca3f4d53a01e3815de2a52bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:28Z,use_quota=True,user_id='6b16bbd0620d41fa9958795beb0166fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Creating volume ebb3129d-3ae6-4472-934d-bf1a883f3e01 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:34 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ebb3129d-3ae6-4472-934d-bf1a883f3e01 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10966b98-304b-44b7-acb6-b3f1b98aa4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f23980ea-e85e-4769-b32a-a0f5c32efa4f', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:34 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ebb3129d-3ae6-4472-934d-bf1a883f3e01 1073741824 Sep 05 05:20:34 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47544555-a83e-421c-b2a1-96750f7281dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:34 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Volume volume-f23980ea-e85e-4769-b32a-a0f5c32efa4f (f23980ea-e85e-4769-b32a-a0f5c32efa4f): created successfully Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47544555-a83e-421c-b2a1-96750f7281dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Flow 'volume_create_manager' (7ce893d5-e471-42d5-b211-553e1b3a1ccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:34 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-65687f4b-937a-4272-bb8f-4fd72c52d854 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Created volume successfully. Sep 05 05:20:34 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-640c4f80-613e-48e3-a508-8377a25ea625 tempest-CinderUnicodeTest-1712953756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe" returned: 0 in 0.391s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-640c4f80-613e-48e3-a508-8377a25ea625 tempest-CinderUnicodeTest-1712953756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.d770372a-9fb2-44d2-862f-a44e78be23ed {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:34 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.d770372a-9fb2-44d2-862f-a44e78be23ed Sep 05 05:20:34 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:34 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ebb3129d-3ae6-4472-934d-bf1a883f3e01 1073741824" returned: 0 in 0.489s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ebb3129d-3ae6-4472-934d-bf1a883f3e01 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:34 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ebb3129d-3ae6-4472-934d-bf1a883f3e01 Sep 05 05:20:34 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:34 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-640c4f80-613e-48e3-a508-8377a25ea625 tempest-CinderUnicodeTest-1712953756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.d770372a-9fb2-44d2-862f-a44e78be23ed" returned: 0 in 0.368s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-640c4f80-613e-48e3-a508-8377a25ea625 tempest-CinderUnicodeTest-1712953756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.d770372a-9fb2-44d2-862f-a44e78be23ed {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:34 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.d770372a-9fb2-44d2-862f-a44e78be23ed Sep 05 05:20:34 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:35 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ebb3129d-3ae6-4472-934d-bf1a883f3e01" returned: 0 in 0.252s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.969s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-736616709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ff6670-9e0e-46ff-9791-82e564022495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c657235a3fda464cafe5a5f233b90991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:30Z,use_quota=True,user_id='27bab183b95b47bb92e8673e0ad0c0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Creating volume 77ff6670-9e0e-46ff-9791-82e564022495 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:35 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-77ff6670-9e0e-46ff-9791-82e564022495 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03889ed-2ec0-454a-8046-56aba480073e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebb3129d-3ae6-4472-934d-bf1a883f3e01', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adcb463c-d02d-481f-ba5a-a3ed2bdd1e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:35 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-77ff6670-9e0e-46ff-9791-82e564022495 1073741824 Sep 05 05:20:35 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:35 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:35 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Volume volume-ebb3129d-3ae6-4472-934d-bf1a883f3e01 (ebb3129d-3ae6-4472-934d-bf1a883f3e01): created successfully Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adcb463c-d02d-481f-ba5a-a3ed2bdd1e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Flow 'volume_create_manager' (710b1f99-3f09-4a15-996b-309bfe5bce67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-640c4f80-613e-48e3-a508-8377a25ea625 tempest-CinderUnicodeTest-1712953756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe.d770372a-9fb2-44d2-862f-a44e78be23ed" returned: 0 in 0.280s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:35 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ff9f2254-bf52-4f48-ad74-9b1bd97d9d3b tempest-CreateVolumesFromSnapshotTest-1241318939 None] Created volume successfully. Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-640c4f80-613e-48e3-a508-8377a25ea625 tempest-CinderUnicodeTest-1712953756 None] Lock "cinder-quobyte-d770372a-9fb2-44d2-862f-a44e78be23ed" released by "_delete_snapshot" :: held 1.536s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-640c4f80-613e-48e3-a508-8377a25ea625 tempest-CinderUnicodeTest-1712953756 None] Lock "cinder-quobyte-b4a0b227-02d0-4842-b887-e7b74962d4fe" released by "delete_snapshot" :: held 1.566s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-640c4f80-613e-48e3-a508-8377a25ea625 tempest-CinderUnicodeTest-1712953756 None] Created reservations ['dbf4d2ac-640e-4cc7-bfbb-2bc02e14b7db', '07550e9b-ad7c-49aa-abd4-a48b596f2b9e', '64a202f0-0781-4e00-a796-e59f4791e4b5', 'cff991b2-41d8-4e3e-bbee-1f8c5f29f489'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:35 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-640c4f80-613e-48e3-a508-8377a25ea625 tempest-CinderUnicodeTest-1712953756 None] Delete snapshot completed successfully. Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-640c4f80-613e-48e3-a508-8377a25ea625 tempest-CinderUnicodeTest-1712953756 None] Lock "cinder-d770372a-9fb2-44d2-862f-a44e78be23ed-delete_snapshot" released by "delete_snapshot" :: held 1.718s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:35 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-77ff6670-9e0e-46ff-9791-82e564022495 1073741824" returned: 0 in 0.429s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-77ff6670-9e0e-46ff-9791-82e564022495 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:35 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-77ff6670-9e0e-46ff-9791-82e564022495 Sep 05 05:20:35 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-088e3e43-44f6-407a-ad09-93c5ea277dc9 tempest-CinderUnicodeTest-1712953756 None] Acquiring lock "cinder-b4a0b227-02d0-4842-b887-e7b74962d4fe-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-088e3e43-44f6-407a-ad09-93c5ea277dc9 tempest-CinderUnicodeTest-1712953756 None] Lock "cinder-b4a0b227-02d0-4842-b887-e7b74962d4fe-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-088e3e43-44f6-407a-ad09-93c5ea277dc9 tempest-CinderUnicodeTest-1712953756 None] Acquiring lock "cinder-quobyte-b4a0b227-02d0-4842-b887-e7b74962d4fe" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:35 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-77ff6670-9e0e-46ff-9791-82e564022495" returned: 0 in 0.286s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.026s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1481470770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e865d2f8-4c05-45d1-a275-5d5e30ea4c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c657235a3fda464cafe5a5f233b90991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:31Z,use_quota=True,user_id='27bab183b95b47bb92e8673e0ad0c0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Creating volume e865d2f8-4c05-45d1-a275-5d5e30ea4c53 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:35 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e865d2f8-4c05-45d1-a275-5d5e30ea4c53 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-088e3e43-44f6-407a-ad09-93c5ea277dc9 tempest-CinderUnicodeTest-1712953756 None] Lock "cinder-quobyte-b4a0b227-02d0-4842-b887-e7b74962d4fe" acquired by "delete_volume" :: waited 0.044s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:35 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e865d2f8-4c05-45d1-a275-5d5e30ea4c53 1073741824 Sep 05 05:20:35 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:35 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (466dcf36-6272-433f-8061-e7538f96efa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77ff6670-9e0e-46ff-9791-82e564022495', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c586c34-cc94-4623-b45c-9edc8fc9f3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bcf6f9-656e-4d6d-a84a-e22246fb1a9d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-088e3e43-44f6-407a-ad09-93c5ea277dc9 tempest-CinderUnicodeTest-1712953756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4b8f0e19-1f48-4bbd-9042-1252e06c2526 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "cinder-ebb3129d-3ae6-4472-934d-bf1a883f3e01-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:36 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Volume volume-77ff6670-9e0e-46ff-9791-82e564022495 (77ff6670-9e0e-46ff-9791-82e564022495): created successfully Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c586c34-cc94-4623-b45c-9edc8fc9f3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Flow 'volume_create_manager' (9d98f696-cb82-49f7-83a8-11ef16a1a63e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4b8f0e19-1f48-4bbd-9042-1252e06c2526 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-ebb3129d-3ae6-4472-934d-bf1a883f3e01-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:36 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-dc9632c7-6209-4b53-9878-b00d87d0b668 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Created volume successfully. Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4b8f0e19-1f48-4bbd-9042-1252e06c2526 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "cinder-quobyte-ebb3129d-3ae6-4472-934d-bf1a883f3e01" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4b8f0e19-1f48-4bbd-9042-1252e06c2526 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-quobyte-ebb3129d-3ae6-4472-934d-bf1a883f3e01" acquired by "delete_volume" :: waited 0.021s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:36 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d316d38-6150-40ae-a608-1989e97d658e]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4b8f0e19-1f48-4bbd-9042-1252e06c2526 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ebb3129d-3ae6-4472-934d-bf1a883f3e01 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:36 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:36 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ebb3129d-3ae6-4472-934d-bf1a883f3e01 Sep 05 05:20:36 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:36 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:36 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e865d2f8-4c05-45d1-a275-5d5e30ea4c53 1073741824" returned: 0 in 0.506s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-088e3e43-44f6-407a-ad09-93c5ea277dc9 tempest-CinderUnicodeTest-1712953756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe" returned: 0 in 0.432s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-088e3e43-44f6-407a-ad09-93c5ea277dc9 tempest-CinderUnicodeTest-1712953756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:36 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe Sep 05 05:20:36 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e865d2f8-4c05-45d1-a275-5d5e30ea4c53 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:36 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e865d2f8-4c05-45d1-a275-5d5e30ea4c53 Sep 05 05:20:36 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:36 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4b8f0e19-1f48-4bbd-9042-1252e06c2526 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ebb3129d-3ae6-4472-934d-bf1a883f3e01" returned: 0 in 0.418s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4b8f0e19-1f48-4bbd-9042-1252e06c2526 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ebb3129d-3ae6-4472-934d-bf1a883f3e01 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:36 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ebb3129d-3ae6-4472-934d-bf1a883f3e01 Sep 05 05:20:36 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:36 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-088e3e43-44f6-407a-ad09-93c5ea277dc9 tempest-CinderUnicodeTest-1712953756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b4a0b227-02d0-4842-b887-e7b74962d4fe" returned: 0 in 0.274s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-088e3e43-44f6-407a-ad09-93c5ea277dc9 tempest-CinderUnicodeTest-1712953756 None] Lock "cinder-quobyte-b4a0b227-02d0-4842-b887-e7b74962d4fe" released by "delete_volume" :: held 0.788s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:36 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e865d2f8-4c05-45d1-a275-5d5e30ea4c53" returned: 0 in 0.253s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.620s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-237439626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cba6322-db19-4626-b16c-1ade64917ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c657235a3fda464cafe5a5f233b90991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:31Z,use_quota=True,user_id='27bab183b95b47bb92e8673e0ad0c0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Creating volume 1cba6322-db19-4626-b16c-1ade64917ff0 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:36 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1cba6322-db19-4626-b16c-1ade64917ff0 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:36 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1cba6322-db19-4626-b16c-1ade64917ff0 1073741824 Sep 05 05:20:36 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb44ffb-439d-44de-87bf-cb7f81d42d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e865d2f8-4c05-45d1-a275-5d5e30ea4c53', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0b6095-3720-482f-9712-0625fdc6d411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:36 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Volume volume-e865d2f8-4c05-45d1-a275-5d5e30ea4c53 (e865d2f8-4c05-45d1-a275-5d5e30ea4c53): created successfully Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0b6095-3720-482f-9712-0625fdc6d411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Flow 'volume_create_manager' (d9fe0422-a3f3-4572-af92-d110b0158f57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:36 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-498e914f-eb59-41ff-9a17-493fa2880210 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Created volume successfully. Sep 05 05:20:36 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-088e3e43-44f6-407a-ad09-93c5ea277dc9 tempest-CinderUnicodeTest-1712953756 None] Created reservations ['878985f8-1eaf-45c9-9320-c261e669b664', '000c62f1-148c-423a-b9f0-075611ba8f41', '4ab9b126-9620-40cb-9913-eb8ddb207bea', '75bac139-2919-4b9e-874e-21fe770b0c7a'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4b8f0e19-1f48-4bbd-9042-1252e06c2526 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ebb3129d-3ae6-4472-934d-bf1a883f3e01" returned: 0 in 0.286s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4b8f0e19-1f48-4bbd-9042-1252e06c2526 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-quobyte-ebb3129d-3ae6-4472-934d-bf1a883f3e01" released by "delete_volume" :: held 0.751s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-088e3e43-44f6-407a-ad09-93c5ea277dc9 tempest-CinderUnicodeTest-1712953756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-088e3e43-44f6-407a-ad09-93c5ea277dc9 tempest-CinderUnicodeTest-1712953756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-088e3e43-44f6-407a-ad09-93c5ea277dc9 tempest-CinderUnicodeTest-1712953756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-088e3e43-44f6-407a-ad09-93c5ea277dc9 tempest-CinderUnicodeTest-1712953756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-088e3e43-44f6-407a-ad09-93c5ea277dc9 tempest-CinderUnicodeTest-1712953756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:36 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-088e3e43-44f6-407a-ad09-93c5ea277dc9 tempest-CinderUnicodeTest-1712953756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:37 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:37 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-4b8f0e19-1f48-4bbd-9042-1252e06c2526 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Created reservations ['b4ab7b73-b59d-4a80-97a0-5d54acda898f', 'c69a5d7d-6a3f-45ac-9b6b-5932f08ed50a', 'b61c81a5-203a-42cc-8065-8061dbc3a713', 'eaee1ae0-6bef-40d7-87ad-d09c84429d3f'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ffd0734d-e884-486c-a902-5aa6c9b804d2 tempest-CinderUnicodeTest-1712953756 None] Acquiring lock "cinder-0d4e0405-f26f-4d7f-a893-446c1e3df45f-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ffd0734d-e884-486c-a902-5aa6c9b804d2 tempest-CinderUnicodeTest-1712953756 None] Lock "cinder-0d4e0405-f26f-4d7f-a893-446c1e3df45f-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ffd0734d-e884-486c-a902-5aa6c9b804d2 tempest-CinderUnicodeTest-1712953756 None] Acquiring lock "cinder-quobyte-0d4e0405-f26f-4d7f-a893-446c1e3df45f" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4b8f0e19-1f48-4bbd-9042-1252e06c2526 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4b8f0e19-1f48-4bbd-9042-1252e06c2526 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4b8f0e19-1f48-4bbd-9042-1252e06c2526 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4b8f0e19-1f48-4bbd-9042-1252e06c2526 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4b8f0e19-1f48-4bbd-9042-1252e06c2526 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4b8f0e19-1f48-4bbd-9042-1252e06c2526 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ffd0734d-e884-486c-a902-5aa6c9b804d2 tempest-CinderUnicodeTest-1712953756 None] Lock "cinder-quobyte-0d4e0405-f26f-4d7f-a893-446c1e3df45f" acquired by "delete_volume" :: waited 0.044s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:37 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:37 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[50345745-69f2-4ce6-b4b2-670e73f99b28]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b4c3cc47-3861-476a-a750-64ef79fd8d30 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "cinder-f23980ea-e85e-4769-b32a-a0f5c32efa4f-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffd0734d-e884-486c-a902-5aa6c9b804d2 tempest-CinderUnicodeTest-1712953756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d4e0405-f26f-4d7f-a893-446c1e3df45f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b4c3cc47-3861-476a-a750-64ef79fd8d30 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-f23980ea-e85e-4769-b32a-a0f5c32efa4f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:37 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:37 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1cba6322-db19-4626-b16c-1ade64917ff0 1073741824" returned: 0 in 0.605s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-088e3e43-44f6-407a-ad09-93c5ea277dc9 tempest-CinderUnicodeTest-1712953756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.386s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-088e3e43-44f6-407a-ad09-93c5ea277dc9 tempest-CinderUnicodeTest-1712953756 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b4c3cc47-3861-476a-a750-64ef79fd8d30 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "cinder-quobyte-f23980ea-e85e-4769-b32a-a0f5c32efa4f" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:37 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-088e3e43-44f6-407a-ad09-93c5ea277dc9 tempest-CinderUnicodeTest-1712953756 None] Deleted volume successfully. Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-088e3e43-44f6-407a-ad09-93c5ea277dc9 tempest-CinderUnicodeTest-1712953756 None] Lock "cinder-b4a0b227-02d0-4842-b887-e7b74962d4fe-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b4c3cc47-3861-476a-a750-64ef79fd8d30 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-quobyte-f23980ea-e85e-4769-b32a-a0f5c32efa4f" acquired by "delete_volume" :: waited 0.041s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:37 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d4e0405-f26f-4d7f-a893-446c1e3df45f Sep 05 05:20:37 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2d2aa5-9e5b-4b95-90c1-a26d3417a0d6]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b4c3cc47-3861-476a-a750-64ef79fd8d30 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f23980ea-e85e-4769-b32a-a0f5c32efa4f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1cba6322-db19-4626-b16c-1ade64917ff0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:37 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1cba6322-db19-4626-b16c-1ade64917ff0 Sep 05 05:20:37 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:37 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4b8f0e19-1f48-4bbd-9042-1252e06c2526 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.352s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-4b8f0e19-1f48-4bbd-9042-1252e06c2526 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:37 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-4b8f0e19-1f48-4bbd-9042-1252e06c2526 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Deleted volume successfully. Sep 05 05:20:37 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f23980ea-e85e-4769-b32a-a0f5c32efa4f Sep 05 05:20:37 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4b8f0e19-1f48-4bbd-9042-1252e06c2526 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-ebb3129d-3ae6-4472-934d-bf1a883f3e01-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:37 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffd0734d-e884-486c-a902-5aa6c9b804d2 tempest-CinderUnicodeTest-1712953756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d4e0405-f26f-4d7f-a893-446c1e3df45f" returned: 0 in 0.436s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffd0734d-e884-486c-a902-5aa6c9b804d2 tempest-CinderUnicodeTest-1712953756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d4e0405-f26f-4d7f-a893-446c1e3df45f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:37 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1cba6322-db19-4626-b16c-1ade64917ff0" returned: 0 in 0.268s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:37 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d4e0405-f26f-4d7f-a893-446c1e3df45f Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:37 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.378s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1889909452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b993874b-3d42-4f53-bd34-9a95c27a2d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c657235a3fda464cafe5a5f233b90991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:31Z,use_quota=True,user_id='27bab183b95b47bb92e8673e0ad0c0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Creating volume b993874b-3d42-4f53-bd34-9a95c27a2d75 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:37 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b993874b-3d42-4f53-bd34-9a95c27a2d75 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:37 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b993874b-3d42-4f53-bd34-9a95c27a2d75 1073741824 Sep 05 05:20:37 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d48354d-77c1-4c29-9b7d-fb9be48291f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cba6322-db19-4626-b16c-1ade64917ff0', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb5a959-8795-483c-8a1c-ec927c011ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:37 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Volume volume-1cba6322-db19-4626-b16c-1ade64917ff0 (1cba6322-db19-4626-b16c-1ade64917ff0): created successfully Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb5a959-8795-483c-8a1c-ec927c011ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Flow 'volume_create_manager' (450160fa-f341-44c0-aecc-d3f1c2d4e5f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:37 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-6658a57d-f522-41a5-9fe7-1d3ce48e2bba tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Created volume successfully. Sep 05 05:20:37 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b4c3cc47-3861-476a-a750-64ef79fd8d30 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f23980ea-e85e-4769-b32a-a0f5c32efa4f" returned: 0 in 0.433s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b4c3cc47-3861-476a-a750-64ef79fd8d30 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f23980ea-e85e-4769-b32a-a0f5c32efa4f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:37 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f23980ea-e85e-4769-b32a-a0f5c32efa4f Sep 05 05:20:37 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:37 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:37 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffd0734d-e884-486c-a902-5aa6c9b804d2 tempest-CinderUnicodeTest-1712953756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d4e0405-f26f-4d7f-a893-446c1e3df45f" returned: 0 in 0.282s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ffd0734d-e884-486c-a902-5aa6c9b804d2 tempest-CinderUnicodeTest-1712953756 None] Lock "cinder-quobyte-0d4e0405-f26f-4d7f-a893-446c1e3df45f" released by "delete_volume" :: held 0.787s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-ffd0734d-e884-486c-a902-5aa6c9b804d2 tempest-CinderUnicodeTest-1712953756 None] Created reservations ['13320c46-1595-4e12-bb66-9a7510659ec2', 'b9e93dc5-8500-47b2-b05c-ac7a899cd1d4', '85ca0608-60b6-4c49-ad4f-03e554aa4282', 'e9b416fb-cf4c-419e-b590-f5c8b84cbd40'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffd0734d-e884-486c-a902-5aa6c9b804d2 tempest-CinderUnicodeTest-1712953756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffd0734d-e884-486c-a902-5aa6c9b804d2 tempest-CinderUnicodeTest-1712953756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ffd0734d-e884-486c-a902-5aa6c9b804d2 tempest-CinderUnicodeTest-1712953756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ffd0734d-e884-486c-a902-5aa6c9b804d2 tempest-CinderUnicodeTest-1712953756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffd0734d-e884-486c-a902-5aa6c9b804d2 tempest-CinderUnicodeTest-1712953756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffd0734d-e884-486c-a902-5aa6c9b804d2 tempest-CinderUnicodeTest-1712953756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:38 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:38 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:38 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b4c3cc47-3861-476a-a750-64ef79fd8d30 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-f23980ea-e85e-4769-b32a-a0f5c32efa4f" returned: 0 in 0.308s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b4c3cc47-3861-476a-a750-64ef79fd8d30 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-quobyte-f23980ea-e85e-4769-b32a-a0f5c32efa4f" released by "delete_volume" :: held 0.789s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:38 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b993874b-3d42-4f53-bd34-9a95c27a2d75 1073741824" returned: 0 in 0.504s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-b4c3cc47-3861-476a-a750-64ef79fd8d30 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Created reservations ['ca9f24f1-cd70-431e-9d36-b79d547f8112', '71d50494-5e13-47ba-9e3e-5625cdc7e454', '6624c6fb-6c91-45b5-8eb7-ae59542d1557', 'c0bb34a5-30cd-49c0-bfe9-ddd67781c533'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b993874b-3d42-4f53-bd34-9a95c27a2d75 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:38 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b993874b-3d42-4f53-bd34-9a95c27a2d75 Sep 05 05:20:38 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b4c3cc47-3861-476a-a750-64ef79fd8d30 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b4c3cc47-3861-476a-a750-64ef79fd8d30 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b4c3cc47-3861-476a-a750-64ef79fd8d30 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b4c3cc47-3861-476a-a750-64ef79fd8d30 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b4c3cc47-3861-476a-a750-64ef79fd8d30 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b4c3cc47-3861-476a-a750-64ef79fd8d30 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:38 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffd0734d-e884-486c-a902-5aa6c9b804d2 tempest-CinderUnicodeTest-1712953756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.302s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-ffd0734d-e884-486c-a902-5aa6c9b804d2 tempest-CinderUnicodeTest-1712953756 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:38 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ffd0734d-e884-486c-a902-5aa6c9b804d2 tempest-CinderUnicodeTest-1712953756 None] Deleted volume successfully. Sep 05 05:20:38 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:38 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ffd0734d-e884-486c-a902-5aa6c9b804d2 tempest-CinderUnicodeTest-1712953756 None] Lock "cinder-0d4e0405-f26f-4d7f-a893-446c1e3df45f-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8af0ae1b-49e8-4925-b479-d32407bfffdb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "cinder-9f90f5c6-7523-4945-b04c-d75dc8759ebf-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8af0ae1b-49e8-4925-b479-d32407bfffdb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-9f90f5c6-7523-4945-b04c-d75dc8759ebf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:38 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b993874b-3d42-4f53-bd34-9a95c27a2d75" returned: 0 in 0.389s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.917s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1891498508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac71f93a-fcb9-43ec-81ef-91b36ac8b7da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c657235a3fda464cafe5a5f233b90991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:32Z,use_quota=True,user_id='27bab183b95b47bb92e8673e0ad0c0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Creating volume ac71f93a-fcb9-43ec-81ef-91b36ac8b7da {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:38 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ac71f93a-fcb9-43ec-81ef-91b36ac8b7da 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8af0ae1b-49e8-4925-b479-d32407bfffdb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "cinder-quobyte-9f90f5c6-7523-4945-b04c-d75dc8759ebf" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:38 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ac71f93a-fcb9-43ec-81ef-91b36ac8b7da 1073741824 Sep 05 05:20:38 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614ab664-06ed-438d-9721-4e2b2dd80a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b993874b-3d42-4f53-bd34-9a95c27a2d75', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca881345-a302-4ff4-abf8-258d654f3441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:38 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Volume volume-b993874b-3d42-4f53-bd34-9a95c27a2d75 (b993874b-3d42-4f53-bd34-9a95c27a2d75): created successfully Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca881345-a302-4ff4-abf8-258d654f3441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:38 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Flow 'volume_create_manager' (d31c37c0-eeae-4aab-8625-fb570669abe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8af0ae1b-49e8-4925-b479-d32407bfffdb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-quobyte-9f90f5c6-7523-4945-b04c-d75dc8759ebf" acquired by "delete_volume" :: waited 0.111s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b4c3cc47-3861-476a-a750-64ef79fd8d30 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.455s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b4c3cc47-3861-476a-a750-64ef79fd8d30 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:38 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-b4c3cc47-3861-476a-a750-64ef79fd8d30 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Deleted volume successfully. Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecce25fd-59e0-4afe-8fa5-f8845c63dae9]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8af0ae1b-49e8-4925-b479-d32407bfffdb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9f90f5c6-7523-4945-b04c-d75dc8759ebf {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:38 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ba0e3a52-d785-42f5-98b9-99119993ab97 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Created volume successfully. Sep 05 05:20:38 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b4c3cc47-3861-476a-a750-64ef79fd8d30 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-f23980ea-e85e-4769-b32a-a0f5c32efa4f-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:39 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9f90f5c6-7523-4945-b04c-d75dc8759ebf Sep 05 05:20:39 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:39 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ac71f93a-fcb9-43ec-81ef-91b36ac8b7da 1073741824" returned: 0 in 0.582s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ac71f93a-fcb9-43ec-81ef-91b36ac8b7da {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:39 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ac71f93a-fcb9-43ec-81ef-91b36ac8b7da Sep 05 05:20:39 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:39 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8af0ae1b-49e8-4925-b479-d32407bfffdb tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9f90f5c6-7523-4945-b04c-d75dc8759ebf" returned: 0 in 0.536s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8af0ae1b-49e8-4925-b479-d32407bfffdb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9f90f5c6-7523-4945-b04c-d75dc8759ebf {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:39 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9f90f5c6-7523-4945-b04c-d75dc8759ebf Sep 05 05:20:39 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:39 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ac71f93a-fcb9-43ec-81ef-91b36ac8b7da" returned: 0 in 0.359s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.370s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1374280265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=551b1eba-f002-453a-ab81-980348784245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddcd468ba4ee4f31ad43c9f153ba3f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:33Z,use_quota=True,user_id='5d90352309854303aa9a3d8d5110463e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Creating volume 551b1eba-f002-453a-ab81-980348784245 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:39 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:39 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19945a6c-1be5-4e44-a34c-c81b20dbc294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac71f93a-fcb9-43ec-81ef-91b36ac8b7da', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:39 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245 1073741824 Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02750475-04e7-49c8-b4e4-1aed2cd13166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:39 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8af0ae1b-49e8-4925-b479-d32407bfffdb tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9f90f5c6-7523-4945-b04c-d75dc8759ebf" returned: 0 in 0.343s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:39 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Volume volume-ac71f93a-fcb9-43ec-81ef-91b36ac8b7da (ac71f93a-fcb9-43ec-81ef-91b36ac8b7da): created successfully Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02750475-04e7-49c8-b4e4-1aed2cd13166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Flow 'volume_create_manager' (64e08d69-c6a4-42ec-b805-515430181141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8af0ae1b-49e8-4925-b479-d32407bfffdb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-quobyte-9f90f5c6-7523-4945-b04c-d75dc8759ebf" released by "delete_volume" :: held 0.954s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:39 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-668d2cf9-2d37-4f1e-8d8e-415f846fb9ed tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Created volume successfully. Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-8af0ae1b-49e8-4925-b479-d32407bfffdb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Created reservations ['5beea629-7a37-43cf-873a-da2c1b084e7d', '153c6fe3-ab71-4146-b553-9a8cb76540cc', 'c15839d6-4a24-43a4-91d7-227747ae3f6a', 'f2e49d0b-b0a4-4298-a0cf-6c6fb7e6ae1a'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8af0ae1b-49e8-4925-b479-d32407bfffdb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8af0ae1b-49e8-4925-b479-d32407bfffdb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8af0ae1b-49e8-4925-b479-d32407bfffdb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8af0ae1b-49e8-4925-b479-d32407bfffdb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8af0ae1b-49e8-4925-b479-d32407bfffdb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8af0ae1b-49e8-4925-b479-d32407bfffdb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:39 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:39 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:40 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245 1073741824" returned: 0 in 0.495s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:40 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8af0ae1b-49e8-4925-b479-d32407bfffdb tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.280s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:40 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-8af0ae1b-49e8-4925-b479-d32407bfffdb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:40 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-8af0ae1b-49e8-4925-b479-d32407bfffdb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Deleted volume successfully. Sep 05 05:20:40 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8af0ae1b-49e8-4925-b479-d32407bfffdb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-9f90f5c6-7523-4945-b04c-d75dc8759ebf-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:40 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245 Sep 05 05:20:40 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:40 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245" returned: 0 in 0.248s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:40 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:40 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac88171-337e-472e-9929-45d05519263e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-551b1eba-f002-453a-ab81-980348784245', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:40 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79313ebb-4993-4e2f-aec1-2be131056b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:40 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Volume volume-551b1eba-f002-453a-ab81-980348784245 (551b1eba-f002-453a-ab81-980348784245): created successfully Sep 05 05:20:40 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79313ebb-4993-4e2f-aec1-2be131056b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:40 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Flow 'volume_create_manager' (5602699b-cacb-4bdb-8255-551187f507c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:40 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-9e1eba7a-3a2e-44f2-bc01-587469c66b9b tempest-ProjectReaderTests-544844019 None] Created volume successfully. Sep 05 05:20:40 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-00cf7d7d-222b-48f5-876c-44d86af45d0f tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "cinder-ac71f93a-fcb9-43ec-81ef-91b36ac8b7da-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:40 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-00cf7d7d-222b-48f5-876c-44d86af45d0f tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-ac71f93a-fcb9-43ec-81ef-91b36ac8b7da-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:40 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-00cf7d7d-222b-48f5-876c-44d86af45d0f tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "cinder-quobyte-ac71f93a-fcb9-43ec-81ef-91b36ac8b7da" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:40 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-00cf7d7d-222b-48f5-876c-44d86af45d0f tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-quobyte-ac71f93a-fcb9-43ec-81ef-91b36ac8b7da" acquired by "delete_volume" :: waited 0.022s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:40 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7246a0-9fc7-4d40-b1e7-c82328f986e5]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-00cf7d7d-222b-48f5-876c-44d86af45d0f tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ac71f93a-fcb9-43ec-81ef-91b36ac8b7da {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:40 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3b6bfe00-7486-4dd4-a1b2-4d8f3f0e769e tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "cinder-72627ce5-2d29-4dc2-a149-05add58bf648-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:40 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3b6bfe00-7486-4dd4-a1b2-4d8f3f0e769e tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-72627ce5-2d29-4dc2-a149-05add58bf648-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:40 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3b6bfe00-7486-4dd4-a1b2-4d8f3f0e769e tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "cinder-quobyte-72627ce5-2d29-4dc2-a149-05add58bf648" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:40 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3b6bfe00-7486-4dd4-a1b2-4d8f3f0e769e tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-quobyte-72627ce5-2d29-4dc2-a149-05add58bf648" acquired by "delete_volume" :: waited 0.032s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c65a827-b8e3-4a65-ad56-1047d003f2c2]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:41 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ac71f93a-fcb9-43ec-81ef-91b36ac8b7da Sep 05 05:20:41 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3b6bfe00-7486-4dd4-a1b2-4d8f3f0e769e tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-72627ce5-2d29-4dc2-a149-05add58bf648 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-42702547-4e2b-449e-b802-c52499237192 tempest-ProjectReaderTests-544844019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-42702547-4e2b-449e-b802-c52499237192 tempest-ProjectReaderTests-544844019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-42702547-4e2b-449e-b802-c52499237192 tempest-ProjectReaderTests-544844019 None] Creating offline snapshot 8c2e8acd-70e2-42ec-b343-5d9a0c106502 of volume 551b1eba-f002-453a-ab81-980348784245 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b034f384-e783-4ec6-8c7d-5848f79ce23f]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-42702547-4e2b-449e-b802-c52499237192 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:41 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-72627ce5-2d29-4dc2-a149-05add58bf648 Sep 05 05:20:41 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:41 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245 Sep 05 05:20:41 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:41 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-00cf7d7d-222b-48f5-876c-44d86af45d0f tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ac71f93a-fcb9-43ec-81ef-91b36ac8b7da" returned: 0 in 0.486s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-00cf7d7d-222b-48f5-876c-44d86af45d0f tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ac71f93a-fcb9-43ec-81ef-91b36ac8b7da {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:41 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ac71f93a-fcb9-43ec-81ef-91b36ac8b7da Sep 05 05:20:41 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:41 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3b6bfe00-7486-4dd4-a1b2-4d8f3f0e769e tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-72627ce5-2d29-4dc2-a149-05add58bf648" returned: 0 in 0.406s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3b6bfe00-7486-4dd4-a1b2-4d8f3f0e769e tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-72627ce5-2d29-4dc2-a149-05add58bf648 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:41 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-72627ce5-2d29-4dc2-a149-05add58bf648 Sep 05 05:20:41 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:41 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-42702547-4e2b-449e-b802-c52499237192 tempest-ProjectReaderTests-544844019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245" returned: 0 in 0.431s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-42702547-4e2b-449e-b802-c52499237192 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.8c2e8acd-70e2-42ec-b343-5d9a0c106502 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:41 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.8c2e8acd-70e2-42ec-b343-5d9a0c106502 1G Sep 05 05:20:41 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:41 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-00cf7d7d-222b-48f5-876c-44d86af45d0f tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ac71f93a-fcb9-43ec-81ef-91b36ac8b7da" returned: 0 in 0.315s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-00cf7d7d-222b-48f5-876c-44d86af45d0f tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-quobyte-ac71f93a-fcb9-43ec-81ef-91b36ac8b7da" released by "delete_volume" :: held 0.871s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-00cf7d7d-222b-48f5-876c-44d86af45d0f tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Created reservations ['ea485c6f-7bb6-4def-b252-0e55fff957c9', '421206f0-a7b1-4390-8489-dd2721296214', '331262c5-2599-4c54-af7b-62bd867bc4d9', 'af2c5dd2-ac63-4e40-99eb-101f121d3c56'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:41 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3b6bfe00-7486-4dd4-a1b2-4d8f3f0e769e tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-72627ce5-2d29-4dc2-a149-05add58bf648" returned: 0 in 0.305s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3b6bfe00-7486-4dd4-a1b2-4d8f3f0e769e tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-quobyte-72627ce5-2d29-4dc2-a149-05add58bf648" released by "delete_volume" :: held 0.768s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-00cf7d7d-222b-48f5-876c-44d86af45d0f tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-00cf7d7d-222b-48f5-876c-44d86af45d0f tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-00cf7d7d-222b-48f5-876c-44d86af45d0f tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-00cf7d7d-222b-48f5-876c-44d86af45d0f tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-00cf7d7d-222b-48f5-876c-44d86af45d0f tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-00cf7d7d-222b-48f5-876c-44d86af45d0f tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-3b6bfe00-7486-4dd4-a1b2-4d8f3f0e769e tempest-CreateVolumesFromSnapshotTest-1241318939 None] Created reservations ['471e0b87-24c6-4b84-b633-81e01fcacf82', 'c3dda62c-f048-4cab-a866-a531942f27f8', '954407fe-3359-44dd-85cc-77a7a3370760', '7bd2172c-920b-4807-b512-55453bd47af1'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:41 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:41 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9456393a-1a02-4864-b9cc-c5144af0a87b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "cinder-b993874b-3d42-4f53-bd34-9a95c27a2d75-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9456393a-1a02-4864-b9cc-c5144af0a87b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-b993874b-3d42-4f53-bd34-9a95c27a2d75-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9456393a-1a02-4864-b9cc-c5144af0a87b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "cinder-quobyte-b993874b-3d42-4f53-bd34-9a95c27a2d75" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3b6bfe00-7486-4dd4-a1b2-4d8f3f0e769e tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3b6bfe00-7486-4dd4-a1b2-4d8f3f0e769e tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3b6bfe00-7486-4dd4-a1b2-4d8f3f0e769e tempest-CreateVolumesFromSnapshotTest-1241318939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3b6bfe00-7486-4dd4-a1b2-4d8f3f0e769e tempest-CreateVolumesFromSnapshotTest-1241318939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3b6bfe00-7486-4dd4-a1b2-4d8f3f0e769e tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3b6bfe00-7486-4dd4-a1b2-4d8f3f0e769e tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:42 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-42702547-4e2b-449e-b802-c52499237192 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.8c2e8acd-70e2-42ec-b343-5d9a0c106502 1G" returned: 0 in 0.621s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-42702547-4e2b-449e-b802-c52499237192 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-551b1eba-f002-453a-ab81-980348784245 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.8c2e8acd-70e2-42ec-b343-5d9a0c106502 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:42 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:42 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9456393a-1a02-4864-b9cc-c5144af0a87b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-quobyte-b993874b-3d42-4f53-bd34-9a95c27a2d75" acquired by "delete_volume" :: waited 0.083s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:42 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-551b1eba-f002-453a-ab81-980348784245 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.8c2e8acd-70e2-42ec-b343-5d9a0c106502 Sep 05 05:20:42 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-20790703-af66-4cf1-8c01-37fef502d1eb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "cinder-63659a33-da35-4fe6-8124-58504de2df2a-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c270007-c076-4521-8f63-c64c545d378a]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9456393a-1a02-4864-b9cc-c5144af0a87b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b993874b-3d42-4f53-bd34-9a95c27a2d75 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-20790703-af66-4cf1-8c01-37fef502d1eb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-63659a33-da35-4fe6-8124-58504de2df2a-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:42 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-00cf7d7d-222b-48f5-876c-44d86af45d0f tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.433s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-00cf7d7d-222b-48f5-876c-44d86af45d0f tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:42 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-00cf7d7d-222b-48f5-876c-44d86af45d0f tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Deleted volume successfully. Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-00cf7d7d-222b-48f5-876c-44d86af45d0f tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-ac71f93a-fcb9-43ec-81ef-91b36ac8b7da-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-20790703-af66-4cf1-8c01-37fef502d1eb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "cinder-quobyte-63659a33-da35-4fe6-8124-58504de2df2a" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-20790703-af66-4cf1-8c01-37fef502d1eb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-quobyte-63659a33-da35-4fe6-8124-58504de2df2a" acquired by "delete_volume" :: waited 0.026s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d9c51d-069b-46f9-8d25-6a864ca9ed0c]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-20790703-af66-4cf1-8c01-37fef502d1eb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63659a33-da35-4fe6-8124-58504de2df2a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:42 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b993874b-3d42-4f53-bd34-9a95c27a2d75 Sep 05 05:20:42 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:42 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3b6bfe00-7486-4dd4-a1b2-4d8f3f0e769e tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.384s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-3b6bfe00-7486-4dd4-a1b2-4d8f3f0e769e tempest-CreateVolumesFromSnapshotTest-1241318939 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:42 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-3b6bfe00-7486-4dd4-a1b2-4d8f3f0e769e tempest-CreateVolumesFromSnapshotTest-1241318939 None] Deleted volume successfully. Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-3b6bfe00-7486-4dd4-a1b2-4d8f3f0e769e tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-72627ce5-2d29-4dc2-a149-05add58bf648-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:42 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63659a33-da35-4fe6-8124-58504de2df2a Sep 05 05:20:42 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:42 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-42702547-4e2b-449e-b802-c52499237192 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-551b1eba-f002-453a-ab81-980348784245 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.8c2e8acd-70e2-42ec-b343-5d9a0c106502" returned: 0 in 0.465s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:42 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-42702547-4e2b-449e-b802-c52499237192 tempest-ProjectReaderTests-544844019 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.8c2e8acd-70e2-42ec-b343-5d9a0c106502 is being set with open permissions: ugo+rw Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-42702547-4e2b-449e-b802-c52499237192 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.8c2e8acd-70e2-42ec-b343-5d9a0c106502 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:42 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.8c2e8acd-70e2-42ec-b343-5d9a0c106502 Sep 05 05:20:42 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:42 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9456393a-1a02-4864-b9cc-c5144af0a87b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b993874b-3d42-4f53-bd34-9a95c27a2d75" returned: 0 in 0.603s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9456393a-1a02-4864-b9cc-c5144af0a87b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b993874b-3d42-4f53-bd34-9a95c27a2d75 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:42 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b993874b-3d42-4f53-bd34-9a95c27a2d75 Sep 05 05:20:42 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:42 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-20790703-af66-4cf1-8c01-37fef502d1eb tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63659a33-da35-4fe6-8124-58504de2df2a" returned: 0 in 0.473s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-20790703-af66-4cf1-8c01-37fef502d1eb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63659a33-da35-4fe6-8124-58504de2df2a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:42 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-42702547-4e2b-449e-b802-c52499237192 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.8c2e8acd-70e2-42ec-b343-5d9a0c106502" returned: 0 in 0.311s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:42 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63659a33-da35-4fe6-8124-58504de2df2a Sep 05 05:20:42 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-42702547-4e2b-449e-b802-c52499237192 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:43 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.info Sep 05 05:20:43 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Flow 'volume_create_manager' (f920fa45-dba7-4e7c-b99f-f0435fbb659f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3ea76a-2b7b-4b0f-b93d-8142cc5e5aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3ea76a-2b7b-4b0f-b93d-8142cc5e5aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-93812023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad580cb1010b4899b3d6f4071f9a30c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:43Z,use_quota=True,user_id='777649d126094987b71ca3b21cd760a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76aa5067-0fcc-4a1f-b729-89811a1d3f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76aa5067-0fcc-4a1f-b729-89811a1d3f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6026ea06-444c-44cc-b2cf-9250cffc83e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6026ea06-444c-44cc-b2cf-9250cffc83e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1', 'volume_name': 'volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (972621b4-30bc-459f-a0c6-5480cb59d382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (972621b4-30bc-459f-a0c6-5480cb59d382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa576ac5-d30a-4acc-a75b-a08cfac4e8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:43 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Volume b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1', 'volume_size': 1} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:43 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9456393a-1a02-4864-b9cc-c5144af0a87b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b993874b-3d42-4f53-bd34-9a95c27a2d75" returned: 0 in 0.343s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9456393a-1a02-4864-b9cc-c5144af0a87b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-quobyte-b993874b-3d42-4f53-bd34-9a95c27a2d75" released by "delete_volume" :: held 1.024s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-9456393a-1a02-4864-b9cc-c5144af0a87b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Created reservations ['d5adde11-8256-4e88-aa1f-de29c83ce5aa', 'f4fd7819-f45d-4e0b-9617-a5610ca1ec88', 'f8e9fca9-eca1-4fa0-a674-9ee014d2aaac', '082aa2dc-a1e2-4d04-bd04-ad20fe5f4f59'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:43 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:43 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-20790703-af66-4cf1-8c01-37fef502d1eb tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-63659a33-da35-4fe6-8124-58504de2df2a" returned: 0 in 0.353s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-42702547-4e2b-449e-b802-c52499237192 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.info" returned: 0 in 0.301s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:43 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-42702547-4e2b-449e-b802-c52499237192 tempest-ProjectReaderTests-544844019 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.info is being set with open permissions: ugo+rw Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-42702547-4e2b-449e-b802-c52499237192 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:43 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.info Sep 05 05:20:43 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-20790703-af66-4cf1-8c01-37fef502d1eb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-quobyte-63659a33-da35-4fe6-8124-58504de2df2a" released by "delete_volume" :: held 0.909s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9456393a-1a02-4864-b9cc-c5144af0a87b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9456393a-1a02-4864-b9cc-c5144af0a87b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9456393a-1a02-4864-b9cc-c5144af0a87b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9456393a-1a02-4864-b9cc-c5144af0a87b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9456393a-1a02-4864-b9cc-c5144af0a87b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9456393a-1a02-4864-b9cc-c5144af0a87b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:43 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-20790703-af66-4cf1-8c01-37fef502d1eb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Created reservations ['87b045cb-015d-4611-a6c5-3f3cf9344dd3', '4e24e0e9-376e-4ec9-b3e7-303a1d968926', '23013ba2-d4cb-4cca-8dc8-a0378df2c801', 'c41084ea-abdf-43fe-b3db-cb98d8f718dd'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:43 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-20790703-af66-4cf1-8c01-37fef502d1eb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-20790703-af66-4cf1-8c01-37fef502d1eb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-20790703-af66-4cf1-8c01-37fef502d1eb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-20790703-af66-4cf1-8c01-37fef502d1eb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-20790703-af66-4cf1-8c01-37fef502d1eb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-20790703-af66-4cf1-8c01-37fef502d1eb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:43 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:43 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:43 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-42702547-4e2b-449e-b802-c52499237192 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.info" returned: 0 in 0.249s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-42702547-4e2b-449e-b802-c52499237192 tempest-ProjectReaderTests-544844019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.498s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.434s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-93812023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad580cb1010b4899b3d6f4071f9a30c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:43Z,use_quota=True,user_id='777649d126094987b71ca3b21cd760a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Creating volume b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:43 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:43 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1 1073741824 Sep 05 05:20:43 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:43 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-42702547-4e2b-449e-b802-c52499237192 tempest-ProjectReaderTests-544844019 None] Create snapshot completed successfully Sep 05 05:20:43 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9456393a-1a02-4864-b9cc-c5144af0a87b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.264s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-9456393a-1a02-4864-b9cc-c5144af0a87b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:43 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-9456393a-1a02-4864-b9cc-c5144af0a87b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Deleted volume successfully. Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9456393a-1a02-4864-b9cc-c5144af0a87b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-b993874b-3d42-4f53-bd34-9a95c27a2d75-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:43 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-20790703-af66-4cf1-8c01-37fef502d1eb tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.289s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-20790703-af66-4cf1-8c01-37fef502d1eb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:43 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-20790703-af66-4cf1-8c01-37fef502d1eb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Deleted volume successfully. Sep 05 05:20:43 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-20790703-af66-4cf1-8c01-37fef502d1eb tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-63659a33-da35-4fe6-8124-58504de2df2a-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:44 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1 1073741824" returned: 0 in 0.468s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:44 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1 Sep 05 05:20:44 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0b8cc39d-3068-45b0-b3c9-10d8baeeada0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "cinder-1cba6322-db19-4626-b16c-1ade64917ff0-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0b8cc39d-3068-45b0-b3c9-10d8baeeada0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-1cba6322-db19-4626-b16c-1ade64917ff0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:44 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8f861b29-f4c8-44de-9ede-cf0f3f61089f tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-8c2e8acd-70e2-42ec-b343-5d9a0c106502-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1" returned: 0 in 0.271s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa576ac5-d30a-4acc-a75b-a08cfac4e8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b611313-a4da-43a1-8b60-77b33f65f0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8f861b29-f4c8-44de-9ede-cf0f3f61089f tempest-ProjectReaderTests-544844019 None] Lock "cinder-8c2e8acd-70e2-42ec-b343-5d9a0c106502-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8f861b29-f4c8-44de-9ede-cf0f3f61089f tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-quobyte-551b1eba-f002-453a-ab81-980348784245" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0b8cc39d-3068-45b0-b3c9-10d8baeeada0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "cinder-quobyte-1cba6322-db19-4626-b16c-1ade64917ff0" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:44 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Volume volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1 (b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1): created successfully Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b611313-a4da-43a1-8b60-77b33f65f0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Flow 'volume_create_manager' (f920fa45-dba7-4e7c-b99f-f0435fbb659f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8f861b29-f4c8-44de-9ede-cf0f3f61089f tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-551b1eba-f002-453a-ab81-980348784245" acquired by "delete_snapshot" :: waited 0.035s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8f861b29-f4c8-44de-9ede-cf0f3f61089f tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-quobyte-8c2e8acd-70e2-42ec-b343-5d9a0c106502" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0b8cc39d-3068-45b0-b3c9-10d8baeeada0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-quobyte-1cba6322-db19-4626-b16c-1ade64917ff0" acquired by "delete_volume" :: waited 0.033s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:44 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-a5bfb904-7cd2-47d2-be21-7a3300fe090b tempest-ProjectMemberTests-1299516133 None] Created volume successfully. Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8f861b29-f4c8-44de-9ede-cf0f3f61089f tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-8c2e8acd-70e2-42ec-b343-5d9a0c106502" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-8f861b29-f4c8-44de-9ede-cf0f3f61089f tempest-ProjectReaderTests-544844019 None] Deleting offline snapshot 8c2e8acd-70e2-42ec-b343-5d9a0c106502 of volume 551b1eba-f002-453a-ab81-980348784245 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-8f861b29-f4c8-44de-9ede-cf0f3f61089f tempest-ProjectReaderTests-544844019 None] snapshot_file for this snap is: volume-551b1eba-f002-453a-ab81-980348784245.8c2e8acd-70e2-42ec-b343-5d9a0c106502 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c61b75-e6c3-4f96-83df-619fb0ad2a1c]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c872ede5-40a5-427a-87c1-ceb004e2356f tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "cinder-e583f6d3-7620-4da0-8900-94d85bb01da6-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0b8cc39d-3068-45b0-b3c9-10d8baeeada0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1cba6322-db19-4626-b16c-1ade64917ff0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b83d0b-fef7-490a-bea7-b24c5f522fa6]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8f861b29-f4c8-44de-9ede-cf0f3f61089f tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.8c2e8acd-70e2-42ec-b343-5d9a0c106502 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c872ede5-40a5-427a-87c1-ceb004e2356f tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-e583f6d3-7620-4da0-8900-94d85bb01da6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c872ede5-40a5-427a-87c1-ceb004e2356f tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "cinder-quobyte-fa4921b6-e544-4953-8061-d159fb91ce3f" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c872ede5-40a5-427a-87c1-ceb004e2356f tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-quobyte-fa4921b6-e544-4953-8061-d159fb91ce3f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c872ede5-40a5-427a-87c1-ceb004e2356f tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "cinder-quobyte-e583f6d3-7620-4da0-8900-94d85bb01da6" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c872ede5-40a5-427a-87c1-ceb004e2356f tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-quobyte-e583f6d3-7620-4da0-8900-94d85bb01da6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-c872ede5-40a5-427a-87c1-ceb004e2356f tempest-CreateVolumesFromSnapshotTest-1241318939 None] Deleting offline snapshot e583f6d3-7620-4da0-8900-94d85bb01da6 of volume fa4921b6-e544-4953-8061-d159fb91ce3f {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:20:44 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1cba6322-db19-4626-b16c-1ade64917ff0 Sep 05 05:20:44 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-c872ede5-40a5-427a-87c1-ceb004e2356f tempest-CreateVolumesFromSnapshotTest-1241318939 None] snapshot_file for this snap is: volume-fa4921b6-e544-4953-8061-d159fb91ce3f.e583f6d3-7620-4da0-8900-94d85bb01da6 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b757c981-4c00-48d0-90dc-f92f7a171327]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c872ede5-40a5-427a-87c1-ceb004e2356f tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.e583f6d3-7620-4da0-8900-94d85bb01da6 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:44 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.8c2e8acd-70e2-42ec-b343-5d9a0c106502 Sep 05 05:20:44 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:44 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.e583f6d3-7620-4da0-8900-94d85bb01da6 Sep 05 05:20:44 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:44 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0b8cc39d-3068-45b0-b3c9-10d8baeeada0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1cba6322-db19-4626-b16c-1ade64917ff0" returned: 0 in 0.392s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0b8cc39d-3068-45b0-b3c9-10d8baeeada0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1cba6322-db19-4626-b16c-1ade64917ff0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:44 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8f861b29-f4c8-44de-9ede-cf0f3f61089f tempest-ProjectReaderTests-544844019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.8c2e8acd-70e2-42ec-b343-5d9a0c106502" returned: 0 in 0.385s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-8f861b29-f4c8-44de-9ede-cf0f3f61089f tempest-ProjectReaderTests-544844019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-551b1eba-f002-453a-ab81-980348784245(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:20:44 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1cba6322-db19-4626-b16c-1ade64917ff0 Sep 05 05:20:44 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42c4ad8-bf87-48e2-ba59-c1d1c5fdfc10]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8f861b29-f4c8-44de-9ede-cf0f3f61089f tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:45 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c872ede5-40a5-427a-87c1-ceb004e2356f tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.e583f6d3-7620-4da0-8900-94d85bb01da6" returned: 0 in 0.395s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-c872ede5-40a5-427a-87c1-ceb004e2356f tempest-CreateVolumesFromSnapshotTest-1241318939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa4921b6-e544-4953-8061-d159fb91ce3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24f4af5-3745-4c7f-8e05-6e4c3d658aa5]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c872ede5-40a5-427a-87c1-ceb004e2356f tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:45 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245 Sep 05 05:20:45 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:45 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0b8cc39d-3068-45b0-b3c9-10d8baeeada0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-1cba6322-db19-4626-b16c-1ade64917ff0" returned: 0 in 0.277s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0b8cc39d-3068-45b0-b3c9-10d8baeeada0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-quobyte-1cba6322-db19-4626-b16c-1ade64917ff0" released by "delete_volume" :: held 0.751s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:45 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f Sep 05 05:20:45 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-0b8cc39d-3068-45b0-b3c9-10d8baeeada0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Created reservations ['31bfea4e-52e0-4dcc-85d5-63c481e615cf', '0b7dda1f-6596-41ec-8911-c179caa3441c', 'f29b87f1-efbc-407c-898f-28aecdae035b', 'ba1525cb-3785-4df7-b9b1-50b0a2cb570d'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0b8cc39d-3068-45b0-b3c9-10d8baeeada0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0b8cc39d-3068-45b0-b3c9-10d8baeeada0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0b8cc39d-3068-45b0-b3c9-10d8baeeada0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0b8cc39d-3068-45b0-b3c9-10d8baeeada0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0b8cc39d-3068-45b0-b3c9-10d8baeeada0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0b8cc39d-3068-45b0-b3c9-10d8baeeada0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:45 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:45 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:45 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8f861b29-f4c8-44de-9ede-cf0f3f61089f tempest-ProjectReaderTests-544844019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245" returned: 0 in 0.480s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8f861b29-f4c8-44de-9ede-cf0f3f61089f tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.8c2e8acd-70e2-42ec-b343-5d9a0c106502 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:45 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.8c2e8acd-70e2-42ec-b343-5d9a0c106502 Sep 05 05:20:45 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2cbe5a65-6996-4d42-b47a-35516af21331 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2cbe5a65-6996-4d42-b47a-35516af21331 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2f8cde8f-3e3c-4fb6-8535-5315c1900b8b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "cinder-e865d2f8-4c05-45d1-a275-5d5e30ea4c53-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:45 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-2cbe5a65-6996-4d42-b47a-35516af21331 tempest-ProjectMemberTests-1299516133 None] Creating offline snapshot cdfac86d-0108-4bdd-86a6-93607a1194ff of volume b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c872ede5-40a5-427a-87c1-ceb004e2356f tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f" returned: 0 in 0.487s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c872ede5-40a5-427a-87c1-ceb004e2356f tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.e583f6d3-7620-4da0-8900-94d85bb01da6 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2f8cde8f-3e3c-4fb6-8535-5315c1900b8b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-e865d2f8-4c05-45d1-a275-5d5e30ea4c53-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4036364-3be1-4055-9620-89d17115d8f2]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2cbe5a65-6996-4d42-b47a-35516af21331 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:45 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.e583f6d3-7620-4da0-8900-94d85bb01da6 Sep 05 05:20:45 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2f8cde8f-3e3c-4fb6-8535-5315c1900b8b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "cinder-quobyte-e865d2f8-4c05-45d1-a275-5d5e30ea4c53" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2f8cde8f-3e3c-4fb6-8535-5315c1900b8b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-quobyte-e865d2f8-4c05-45d1-a275-5d5e30ea4c53" acquired by "delete_volume" :: waited 0.021s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c231fff-96fe-403a-8d29-147b74047721]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2f8cde8f-3e3c-4fb6-8535-5315c1900b8b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e865d2f8-4c05-45d1-a275-5d5e30ea4c53 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:45 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0b8cc39d-3068-45b0-b3c9-10d8baeeada0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.379s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-0b8cc39d-3068-45b0-b3c9-10d8baeeada0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:45 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-0b8cc39d-3068-45b0-b3c9-10d8baeeada0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Deleted volume successfully. Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0b8cc39d-3068-45b0-b3c9-10d8baeeada0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-1cba6322-db19-4626-b16c-1ade64917ff0-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:45 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1 Sep 05 05:20:45 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:45 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e865d2f8-4c05-45d1-a275-5d5e30ea4c53 Sep 05 05:20:45 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:45 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8f861b29-f4c8-44de-9ede-cf0f3f61089f tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.8c2e8acd-70e2-42ec-b343-5d9a0c106502" returned: 0 in 0.492s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8f861b29-f4c8-44de-9ede-cf0f3f61089f tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.8c2e8acd-70e2-42ec-b343-5d9a0c106502 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:45 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.8c2e8acd-70e2-42ec-b343-5d9a0c106502 Sep 05 05:20:45 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:46 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c872ede5-40a5-427a-87c1-ceb004e2356f tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.e583f6d3-7620-4da0-8900-94d85bb01da6" returned: 0 in 0.454s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c872ede5-40a5-427a-87c1-ceb004e2356f tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.e583f6d3-7620-4da0-8900-94d85bb01da6 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:46 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.e583f6d3-7620-4da0-8900-94d85bb01da6 Sep 05 05:20:46 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:46 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2cbe5a65-6996-4d42-b47a-35516af21331 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1" returned: 0 in 0.512s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2cbe5a65-6996-4d42-b47a-35516af21331 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.cdfac86d-0108-4bdd-86a6-93607a1194ff 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:46 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2f8cde8f-3e3c-4fb6-8535-5315c1900b8b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e865d2f8-4c05-45d1-a275-5d5e30ea4c53" returned: 0 in 0.415s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2f8cde8f-3e3c-4fb6-8535-5315c1900b8b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e865d2f8-4c05-45d1-a275-5d5e30ea4c53 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:46 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.cdfac86d-0108-4bdd-86a6-93607a1194ff 1G Sep 05 05:20:46 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:46 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e865d2f8-4c05-45d1-a275-5d5e30ea4c53 Sep 05 05:20:46 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:46 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8f861b29-f4c8-44de-9ede-cf0f3f61089f tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245.8c2e8acd-70e2-42ec-b343-5d9a0c106502" returned: 0 in 0.300s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8f861b29-f4c8-44de-9ede-cf0f3f61089f tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-8c2e8acd-70e2-42ec-b343-5d9a0c106502" released by "_delete_snapshot" :: held 1.796s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8f861b29-f4c8-44de-9ede-cf0f3f61089f tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-551b1eba-f002-453a-ab81-980348784245" released by "delete_snapshot" :: held 1.848s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:46 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c872ede5-40a5-427a-87c1-ceb004e2356f tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f.e583f6d3-7620-4da0-8900-94d85bb01da6" returned: 0 in 0.294s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c872ede5-40a5-427a-87c1-ceb004e2356f tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-quobyte-e583f6d3-7620-4da0-8900-94d85bb01da6" released by "_delete_snapshot" :: held 1.762s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c872ede5-40a5-427a-87c1-ceb004e2356f tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-quobyte-fa4921b6-e544-4953-8061-d159fb91ce3f" released by "delete_snapshot" :: held 1.791s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-8f861b29-f4c8-44de-9ede-cf0f3f61089f tempest-ProjectReaderTests-544844019 None] Created reservations ['30fe96dd-a1f6-4d13-8274-99fa26144aa4', '8b36f6cb-425d-4bd1-b42d-740c864a2033', '32c502d2-9ed1-4f13-9116-7d5a78d77874', '1298146c-c034-465f-b0b3-9b6079771e8b'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:46 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2f8cde8f-3e3c-4fb6-8535-5315c1900b8b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e865d2f8-4c05-45d1-a275-5d5e30ea4c53" returned: 0 in 0.273s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2f8cde8f-3e3c-4fb6-8535-5315c1900b8b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-quobyte-e865d2f8-4c05-45d1-a275-5d5e30ea4c53" released by "delete_volume" :: held 0.740s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:46 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-8f861b29-f4c8-44de-9ede-cf0f3f61089f tempest-ProjectReaderTests-544844019 None] Delete snapshot completed successfully. Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8f861b29-f4c8-44de-9ede-cf0f3f61089f tempest-ProjectReaderTests-544844019 None] Lock "cinder-8c2e8acd-70e2-42ec-b343-5d9a0c106502-delete_snapshot" released by "delete_snapshot" :: held 2.131s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-c872ede5-40a5-427a-87c1-ceb004e2356f tempest-CreateVolumesFromSnapshotTest-1241318939 None] Created reservations ['ef374372-4dbf-48e6-8b9d-0be424e0230f', '7b1de304-247d-43ba-b642-314ed42e894b', '33af4734-fb7a-49ab-abb1-2ed9b7ac0303', '20894669-1e1d-42e4-a412-ca0cdd546c87'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-2f8cde8f-3e3c-4fb6-8535-5315c1900b8b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Created reservations ['737f220a-022a-4f01-9eca-3c91eb897bb9', '5271f692-6f10-4478-9249-99678d2c14f0', 'fa3bd345-bdfe-4317-b862-b3aabf0e5063', '2dd0ff0d-65fa-4949-ae34-26e5f5fb204e'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-118dc744-404f-42a8-8ce1-64d4b020bca6 tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-551b1eba-f002-453a-ab81-980348784245-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:46 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-c872ede5-40a5-427a-87c1-ceb004e2356f tempest-CreateVolumesFromSnapshotTest-1241318939 None] Delete snapshot completed successfully. Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c872ede5-40a5-427a-87c1-ceb004e2356f tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-e583f6d3-7620-4da0-8900-94d85bb01da6-delete_snapshot" released by "delete_snapshot" :: held 2.064s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-118dc744-404f-42a8-8ce1-64d4b020bca6 tempest-ProjectReaderTests-544844019 None] Lock "cinder-551b1eba-f002-453a-ab81-980348784245-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:46 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2cbe5a65-6996-4d42-b47a-35516af21331 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.cdfac86d-0108-4bdd-86a6-93607a1194ff 1G" returned: 0 in 0.526s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2cbe5a65-6996-4d42-b47a-35516af21331 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.cdfac86d-0108-4bdd-86a6-93607a1194ff {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2f8cde8f-3e3c-4fb6-8535-5315c1900b8b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2f8cde8f-3e3c-4fb6-8535-5315c1900b8b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2f8cde8f-3e3c-4fb6-8535-5315c1900b8b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2f8cde8f-3e3c-4fb6-8535-5315c1900b8b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2f8cde8f-3e3c-4fb6-8535-5315c1900b8b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2f8cde8f-3e3c-4fb6-8535-5315c1900b8b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:46 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.cdfac86d-0108-4bdd-86a6-93607a1194ff Sep 05 05:20:46 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:46 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:46 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0052c68f-9c04-45d6-877a-023aac25d336 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "cinder-fa4921b6-e544-4953-8061-d159fb91ce3f-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-118dc744-404f-42a8-8ce1-64d4b020bca6 tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-quobyte-551b1eba-f002-453a-ab81-980348784245" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0052c68f-9c04-45d6-877a-023aac25d336 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-fa4921b6-e544-4953-8061-d159fb91ce3f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-118dc744-404f-42a8-8ce1-64d4b020bca6 tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-551b1eba-f002-453a-ab81-980348784245" acquired by "delete_volume" :: waited 0.048s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d8a6ff30-ecb7-403e-8e74-90e2bcff0cf4 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "cinder-77ff6670-9e0e-46ff-9791-82e564022495-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0052c68f-9c04-45d6-877a-023aac25d336 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "cinder-quobyte-fa4921b6-e544-4953-8061-d159fb91ce3f" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d34ce54-dcda-47c4-8405-f9547e283584]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-118dc744-404f-42a8-8ce1-64d4b020bca6 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d8a6ff30-ecb7-403e-8e74-90e2bcff0cf4 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-77ff6670-9e0e-46ff-9791-82e564022495-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0052c68f-9c04-45d6-877a-023aac25d336 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-quobyte-fa4921b6-e544-4953-8061-d159fb91ce3f" acquired by "delete_volume" :: waited 0.057s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecba296-422c-4f49-b030-a24a6e0f1c20]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0052c68f-9c04-45d6-877a-023aac25d336 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d8a6ff30-ecb7-403e-8e74-90e2bcff0cf4 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "cinder-quobyte-77ff6670-9e0e-46ff-9791-82e564022495" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d8a6ff30-ecb7-403e-8e74-90e2bcff0cf4 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-quobyte-77ff6670-9e0e-46ff-9791-82e564022495" acquired by "delete_volume" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b07b6ea-2c23-4639-8a4f-0246aeeae9d9]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d8a6ff30-ecb7-403e-8e74-90e2bcff0cf4 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-77ff6670-9e0e-46ff-9791-82e564022495 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:47 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2cbe5a65-6996-4d42-b47a-35516af21331 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.cdfac86d-0108-4bdd-86a6-93607a1194ff" returned: 0 in 0.426s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:47 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-2cbe5a65-6996-4d42-b47a-35516af21331 tempest-ProjectMemberTests-1299516133 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.cdfac86d-0108-4bdd-86a6-93607a1194ff is being set with open permissions: ugo+rw Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2cbe5a65-6996-4d42-b47a-35516af21331 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.cdfac86d-0108-4bdd-86a6-93607a1194ff {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:47 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245 Sep 05 05:20:47 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:47 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2f8cde8f-3e3c-4fb6-8535-5315c1900b8b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.416s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-2f8cde8f-3e3c-4fb6-8535-5315c1900b8b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:47 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.cdfac86d-0108-4bdd-86a6-93607a1194ff Sep 05 05:20:47 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:47 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-2f8cde8f-3e3c-4fb6-8535-5315c1900b8b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Deleted volume successfully. Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-2f8cde8f-3e3c-4fb6-8535-5315c1900b8b tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-e865d2f8-4c05-45d1-a275-5d5e30ea4c53-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:47 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f Sep 05 05:20:47 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:47 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-77ff6670-9e0e-46ff-9791-82e564022495 Sep 05 05:20:47 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:47 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2cbe5a65-6996-4d42-b47a-35516af21331 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.cdfac86d-0108-4bdd-86a6-93607a1194ff" returned: 0 in 0.303s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2cbe5a65-6996-4d42-b47a-35516af21331 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:47 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-118dc744-404f-42a8-8ce1-64d4b020bca6 tempest-ProjectReaderTests-544844019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245" returned: 0 in 0.541s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-118dc744-404f-42a8-8ce1-64d4b020bca6 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:47 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.info Sep 05 05:20:47 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:47 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245 Sep 05 05:20:47 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:47 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0052c68f-9c04-45d6-877a-023aac25d336 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f" returned: 0 in 0.486s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0052c68f-9c04-45d6-877a-023aac25d336 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:47 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d8a6ff30-ecb7-403e-8e74-90e2bcff0cf4 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-77ff6670-9e0e-46ff-9791-82e564022495" returned: 0 in 0.445s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d8a6ff30-ecb7-403e-8e74-90e2bcff0cf4 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-77ff6670-9e0e-46ff-9791-82e564022495 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:47 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f Sep 05 05:20:47 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:47 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-77ff6670-9e0e-46ff-9791-82e564022495 Sep 05 05:20:47 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:47 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2cbe5a65-6996-4d42-b47a-35516af21331 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.info" returned: 0 in 0.295s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:47 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-2cbe5a65-6996-4d42-b47a-35516af21331 tempest-ProjectMemberTests-1299516133 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.info is being set with open permissions: ugo+rw Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2cbe5a65-6996-4d42-b47a-35516af21331 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:47 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-118dc744-404f-42a8-8ce1-64d4b020bca6 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-551b1eba-f002-453a-ab81-980348784245" returned: 0 in 0.299s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:47 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.info Sep 05 05:20:47 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-118dc744-404f-42a8-8ce1-64d4b020bca6 tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-551b1eba-f002-453a-ab81-980348784245" released by "delete_volume" :: held 0.966s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:47 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0052c68f-9c04-45d6-877a-023aac25d336 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa4921b6-e544-4953-8061-d159fb91ce3f" returned: 0 in 0.302s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0052c68f-9c04-45d6-877a-023aac25d336 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-quobyte-fa4921b6-e544-4953-8061-d159fb91ce3f" released by "delete_volume" :: held 0.869s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:47 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d8a6ff30-ecb7-403e-8e74-90e2bcff0cf4 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-77ff6670-9e0e-46ff-9791-82e564022495" returned: 0 in 0.307s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d8a6ff30-ecb7-403e-8e74-90e2bcff0cf4 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-quobyte-77ff6670-9e0e-46ff-9791-82e564022495" released by "delete_volume" :: held 0.815s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-118dc744-404f-42a8-8ce1-64d4b020bca6 tempest-ProjectReaderTests-544844019 None] Created reservations ['87e6a142-ed38-4625-b485-dea221eca4c2', '2fc2ebcf-7571-40c7-a61c-2957af74c45c', '9dedecd9-c0ac-4b61-b019-5f79e330c14b', 'a5e06b52-968b-490b-a4b1-fe7c31016e3a'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-0052c68f-9c04-45d6-877a-023aac25d336 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Created reservations ['e0b7cdbb-9a8e-4c33-ad99-5cf4526f0d30', '0986bff6-9c2e-41ce-b16b-609eea271737', '3ec250cd-d4b4-48eb-988b-04319f78ab34', '8677b700-b0ae-4054-8768-eb7c2ff126ab'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-d8a6ff30-ecb7-403e-8e74-90e2bcff0cf4 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Created reservations ['1bae8625-3e35-4199-ae8d-167460ecb098', 'a8b2c370-5ea4-44b4-8d0e-9c169e035772', '49f84376-ed85-454a-b5e8-517278604f44', '8ccc5821-8275-4ae1-b25a-cb96d0d10d3e'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-118dc744-404f-42a8-8ce1-64d4b020bca6 tempest-ProjectReaderTests-544844019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-118dc744-404f-42a8-8ce1-64d4b020bca6 tempest-ProjectReaderTests-544844019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-118dc744-404f-42a8-8ce1-64d4b020bca6 tempest-ProjectReaderTests-544844019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-118dc744-404f-42a8-8ce1-64d4b020bca6 tempest-ProjectReaderTests-544844019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-118dc744-404f-42a8-8ce1-64d4b020bca6 tempest-ProjectReaderTests-544844019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-118dc744-404f-42a8-8ce1-64d4b020bca6 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:47 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2cbe5a65-6996-4d42-b47a-35516af21331 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.info" returned: 0 in 0.306s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:48 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:48 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2cbe5a65-6996-4d42-b47a-35516af21331 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.533s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0052c68f-9c04-45d6-877a-023aac25d336 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0052c68f-9c04-45d6-877a-023aac25d336 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0052c68f-9c04-45d6-877a-023aac25d336 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0052c68f-9c04-45d6-877a-023aac25d336 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0052c68f-9c04-45d6-877a-023aac25d336 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0052c68f-9c04-45d6-877a-023aac25d336 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:48 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:48 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:48 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-2cbe5a65-6996-4d42-b47a-35516af21331 tempest-ProjectMemberTests-1299516133 None] Create snapshot completed successfully Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f99d27c1-1d4e-4a9d-8322-68134ec11aa0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "cinder-73b2f2ff-3ebe-4a4c-b13e-076aace8d73a-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d8a6ff30-ecb7-403e-8e74-90e2bcff0cf4 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d8a6ff30-ecb7-403e-8e74-90e2bcff0cf4 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d8a6ff30-ecb7-403e-8e74-90e2bcff0cf4 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d8a6ff30-ecb7-403e-8e74-90e2bcff0cf4 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d8a6ff30-ecb7-403e-8e74-90e2bcff0cf4 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d8a6ff30-ecb7-403e-8e74-90e2bcff0cf4 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:48 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:48 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f99d27c1-1d4e-4a9d-8322-68134ec11aa0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-73b2f2ff-3ebe-4a4c-b13e-076aace8d73a-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f99d27c1-1d4e-4a9d-8322-68134ec11aa0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "cinder-quobyte-73b2f2ff-3ebe-4a4c-b13e-076aace8d73a" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f99d27c1-1d4e-4a9d-8322-68134ec11aa0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-quobyte-73b2f2ff-3ebe-4a4c-b13e-076aace8d73a" acquired by "delete_volume" :: waited 0.019s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[65925e41-6e03-4478-a8a2-7f7290467fef]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f99d27c1-1d4e-4a9d-8322-68134ec11aa0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-73b2f2ff-3ebe-4a4c-b13e-076aace8d73a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:48 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-118dc744-404f-42a8-8ce1-64d4b020bca6 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.317s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-118dc744-404f-42a8-8ce1-64d4b020bca6 tempest-ProjectReaderTests-544844019 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:48 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-118dc744-404f-42a8-8ce1-64d4b020bca6 tempest-ProjectReaderTests-544844019 None] Deleted volume successfully. Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-118dc744-404f-42a8-8ce1-64d4b020bca6 tempest-ProjectReaderTests-544844019 None] Lock "cinder-551b1eba-f002-453a-ab81-980348784245-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:48 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0052c68f-9c04-45d6-877a-023aac25d336 tempest-CreateVolumesFromSnapshotTest-1241318939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.331s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-0052c68f-9c04-45d6-877a-023aac25d336 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:48 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-0052c68f-9c04-45d6-877a-023aac25d336 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Deleted volume successfully. Sep 05 05:20:48 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-73b2f2ff-3ebe-4a4c-b13e-076aace8d73a Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0052c68f-9c04-45d6-877a-023aac25d336 tempest-CreateVolumesFromSnapshotTest-1241318939 None] Lock "cinder-fa4921b6-e544-4953-8061-d159fb91ce3f-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:48 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:48 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d8a6ff30-ecb7-403e-8e74-90e2bcff0cf4 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.297s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-d8a6ff30-ecb7-403e-8e74-90e2bcff0cf4 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:48 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-d8a6ff30-ecb7-403e-8e74-90e2bcff0cf4 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Deleted volume successfully. Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d8a6ff30-ecb7-403e-8e74-90e2bcff0cf4 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-77ff6670-9e0e-46ff-9791-82e564022495-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:48 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8a909a36-4f54-4667-b2cc-1312b3f8f126 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-cdfac86d-0108-4bdd-86a6-93607a1194ff-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f99d27c1-1d4e-4a9d-8322-68134ec11aa0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-73b2f2ff-3ebe-4a4c-b13e-076aace8d73a" returned: 0 in 0.409s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f99d27c1-1d4e-4a9d-8322-68134ec11aa0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-73b2f2ff-3ebe-4a4c-b13e-076aace8d73a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8a909a36-4f54-4667-b2cc-1312b3f8f126 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-cdfac86d-0108-4bdd-86a6-93607a1194ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8a909a36-4f54-4667-b2cc-1312b3f8f126 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:48 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-73b2f2ff-3ebe-4a4c-b13e-076aace8d73a Sep 05 05:20:48 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8a909a36-4f54-4667-b2cc-1312b3f8f126 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8a909a36-4f54-4667-b2cc-1312b3f8f126 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-cdfac86d-0108-4bdd-86a6-93607a1194ff" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8a909a36-4f54-4667-b2cc-1312b3f8f126 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-cdfac86d-0108-4bdd-86a6-93607a1194ff" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-8a909a36-4f54-4667-b2cc-1312b3f8f126 tempest-ProjectMemberTests-1299516133 None] Deleting offline snapshot cdfac86d-0108-4bdd-86a6-93607a1194ff of volume b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-8a909a36-4f54-4667-b2cc-1312b3f8f126 tempest-ProjectMemberTests-1299516133 None] snapshot_file for this snap is: volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.cdfac86d-0108-4bdd-86a6-93607a1194ff {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[872a37ef-1106-4074-9b43-bb7f35fe1591]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8a909a36-4f54-4667-b2cc-1312b3f8f126 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.cdfac86d-0108-4bdd-86a6-93607a1194ff {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:48 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.cdfac86d-0108-4bdd-86a6-93607a1194ff Sep 05 05:20:48 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:48 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f99d27c1-1d4e-4a9d-8322-68134ec11aa0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-73b2f2ff-3ebe-4a4c-b13e-076aace8d73a" returned: 0 in 0.286s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f99d27c1-1d4e-4a9d-8322-68134ec11aa0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-quobyte-73b2f2ff-3ebe-4a4c-b13e-076aace8d73a" released by "delete_volume" :: held 0.746s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-f99d27c1-1d4e-4a9d-8322-68134ec11aa0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Created reservations ['139e47bc-f690-46dc-9a53-d1461ae17f52', '497ffd95-9f2d-4016-b717-b9be063f0e16', '9746019c-258a-4cd6-aed6-cab5159c0440', '9313301f-7dc7-421f-9936-dbf40c23b0f9'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f99d27c1-1d4e-4a9d-8322-68134ec11aa0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f99d27c1-1d4e-4a9d-8322-68134ec11aa0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f99d27c1-1d4e-4a9d-8322-68134ec11aa0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f99d27c1-1d4e-4a9d-8322-68134ec11aa0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f99d27c1-1d4e-4a9d-8322-68134ec11aa0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f99d27c1-1d4e-4a9d-8322-68134ec11aa0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:49 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:49 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:49 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8a909a36-4f54-4667-b2cc-1312b3f8f126 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.cdfac86d-0108-4bdd-86a6-93607a1194ff" returned: 0 in 0.451s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-8a909a36-4f54-4667-b2cc-1312b3f8f126 tempest-ProjectMemberTests-1299516133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bb66f1-6967-4160-8af9-04ef1ea8e117]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8a909a36-4f54-4667-b2cc-1312b3f8f126 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:49 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1 Sep 05 05:20:49 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Flow 'volume_create_manager' (9f111b16-83ef-4b4f-be9d-9fa3dc42d801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d6e4ac-624d-4c58-b273-792f848eb61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d6e4ac-624d-4c58-b273-792f848eb61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-755549287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa841490-fdb4-4b64-9cca-e55133d97074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddcd468ba4ee4f31ad43c9f153ba3f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:49Z,use_quota=True,user_id='5d90352309854303aa9a3d8d5110463e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b45317a7-eb95-434d-b839-4aeee9bce848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b45317a7-eb95-434d-b839-4aeee9bce848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:49 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296cd92c-9d50-49c1-9a71-2193e1d3f43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296cd92c-9d50-49c1-9a71-2193e1d3f43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa841490-fdb4-4b64-9cca-e55133d97074', 'volume_name': 'volume-fa841490-fdb4-4b64-9cca-e55133d97074', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0da5cda-919b-4757-abd4-0b44eae602e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0da5cda-919b-4757-abd4-0b44eae602e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164f4fa3-de21-4bc3-be21-ac2fe5d3af41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:49 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Volume fa841490-fdb4-4b64-9cca-e55133d97074: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa841490-fdb4-4b64-9cca-e55133d97074', 'volume_size': 1} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-755549287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa841490-fdb4-4b64-9cca-e55133d97074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddcd468ba4ee4f31ad43c9f153ba3f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:49Z,use_quota=True,user_id='5d90352309854303aa9a3d8d5110463e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Creating volume fa841490-fdb4-4b64-9cca-e55133d97074 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:49 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f99d27c1-1d4e-4a9d-8322-68134ec11aa0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.488s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-f99d27c1-1d4e-4a9d-8322-68134ec11aa0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:49 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-f99d27c1-1d4e-4a9d-8322-68134ec11aa0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Deleted volume successfully. Sep 05 05:20:49 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074 1073741824 Sep 05 05:20:49 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f99d27c1-1d4e-4a9d-8322-68134ec11aa0 tempest-CreateVolumesFromSourceVolumeTest-1904916106 None] Lock "cinder-73b2f2ff-3ebe-4a4c-b13e-076aace8d73a-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:49 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:49 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:49 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8a909a36-4f54-4667-b2cc-1312b3f8f126 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1" returned: 0 in 0.532s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8a909a36-4f54-4667-b2cc-1312b3f8f126 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.cdfac86d-0108-4bdd-86a6-93607a1194ff {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:49 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.cdfac86d-0108-4bdd-86a6-93607a1194ff Sep 05 05:20:49 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:50 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.446s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:50 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:50 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager._thread_info {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:20:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread count: 29 {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 05:20:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread info: [<_MainThread(MainThread, started 139182109970560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 05:20:50 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074 1073741824" returned: 0 in 0.702s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:50 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8a909a36-4f54-4667-b2cc-1312b3f8f126 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.cdfac86d-0108-4bdd-86a6-93607a1194ff" returned: 0 in 0.544s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8a909a36-4f54-4667-b2cc-1312b3f8f126 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.cdfac86d-0108-4bdd-86a6-93607a1194ff {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:50 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.cdfac86d-0108-4bdd-86a6-93607a1194ff Sep 05 05:20:50 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:50 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074 Sep 05 05:20:50 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:50 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8a909a36-4f54-4667-b2cc-1312b3f8f126 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1.cdfac86d-0108-4bdd-86a6-93607a1194ff" returned: 0 in 0.327s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:50 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074" returned: 0 in 0.293s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164f4fa3-de21-4bc3-be21-ac2fe5d3af41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa841490-fdb4-4b64-9cca-e55133d97074', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a695f7-efc9-41b5-ae29-c4286e13517e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:50 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8a909a36-4f54-4667-b2cc-1312b3f8f126 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-cdfac86d-0108-4bdd-86a6-93607a1194ff" released by "_delete_snapshot" :: held 2.037s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:50 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Volume volume-fa841490-fdb4-4b64-9cca-e55133d97074 (fa841490-fdb4-4b64-9cca-e55133d97074): created successfully Sep 05 05:20:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a695f7-efc9-41b5-ae29-c4286e13517e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Flow 'volume_create_manager' (9f111b16-83ef-4b4f-be9d-9fa3dc42d801) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:50 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8a909a36-4f54-4667-b2cc-1312b3f8f126 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1" released by "delete_snapshot" :: held 2.078s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:50 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-36862d6e-458b-4cf9-8bb7-dbb8115ac107 tempest-ProjectReaderTests-544844019 None] Created volume successfully. Sep 05 05:20:50 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-8a909a36-4f54-4667-b2cc-1312b3f8f126 tempest-ProjectMemberTests-1299516133 None] Created reservations ['ec734670-6943-4cdb-8103-fe62e768f484', 'd58b6a26-66c2-40af-aadd-19ce17bc4ee3', 'd9e4a5ce-70e5-4854-9ab7-56d8eebcda77', '7e38f872-5a1a-493e-be31-4c9608242e70'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:50 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-8a909a36-4f54-4667-b2cc-1312b3f8f126 tempest-ProjectMemberTests-1299516133 None] Delete snapshot completed successfully. Sep 05 05:20:50 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8a909a36-4f54-4667-b2cc-1312b3f8f126 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-cdfac86d-0108-4bdd-86a6-93607a1194ff-delete_snapshot" released by "delete_snapshot" :: held 2.268s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d1566478-4e10-4a56-a85c-c78d22e108ec tempest-ProjectReaderTests-544844019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d1566478-4e10-4a56-a85c-c78d22e108ec tempest-ProjectReaderTests-544844019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-d1566478-4e10-4a56-a85c-c78d22e108ec tempest-ProjectReaderTests-544844019 None] Creating offline snapshot fa002f37-bae7-4931-b6d8-aae729fb9a3a of volume fa841490-fdb4-4b64-9cca-e55133d97074 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:20:51 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4a0fa3-036b-4853-ac2e-0fb29859ed39]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d1566478-4e10-4a56-a85c-c78d22e108ec tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:51 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074 Sep 05 05:20:51 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:51 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-96636c6c-e74f-454a-a0c8-3344ba3a7851 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-96636c6c-e74f-454a-a0c8-3344ba3a7851 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-96636c6c-e74f-454a-a0c8-3344ba3a7851 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-96636c6c-e74f-454a-a0c8-3344ba3a7851 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1" acquired by "delete_volume" :: waited 0.030s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:52 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[68040246-6746-4c22-893c-101cb04b6b00]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-96636c6c-e74f-454a-a0c8-3344ba3a7851 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:52 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d1566478-4e10-4a56-a85c-c78d22e108ec tempest-ProjectReaderTests-544844019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074" returned: 0 in 0.405s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d1566478-4e10-4a56-a85c-c78d22e108ec tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.fa002f37-bae7-4931-b6d8-aae729fb9a3a 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:52 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.fa002f37-bae7-4931-b6d8-aae729fb9a3a 1G Sep 05 05:20:52 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:52 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1 Sep 05 05:20:52 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:52 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-96636c6c-e74f-454a-a0c8-3344ba3a7851 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1" returned: 0 in 0.414s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-96636c6c-e74f-454a-a0c8-3344ba3a7851 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:52 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1 Sep 05 05:20:52 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:52 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d1566478-4e10-4a56-a85c-c78d22e108ec tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.fa002f37-bae7-4931-b6d8-aae729fb9a3a 1G" returned: 0 in 0.501s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d1566478-4e10-4a56-a85c-c78d22e108ec tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa841490-fdb4-4b64-9cca-e55133d97074 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.fa002f37-bae7-4931-b6d8-aae729fb9a3a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:52 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa841490-fdb4-4b64-9cca-e55133d97074 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.fa002f37-bae7-4931-b6d8-aae729fb9a3a Sep 05 05:20:52 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:52 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-96636c6c-e74f-454a-a0c8-3344ba3a7851 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1" returned: 0 in 0.285s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-96636c6c-e74f-454a-a0c8-3344ba3a7851 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1" released by "delete_volume" :: held 0.776s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:52 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-96636c6c-e74f-454a-a0c8-3344ba3a7851 tempest-ProjectMemberTests-1299516133 None] Created reservations ['d7abe85c-e348-4643-802c-6a4b6c3f9f04', 'ee30b7c0-be8e-4a07-93f2-d6fc35016ef3', 'c840d494-04b6-4e8e-87ff-7acaaf694817', 'fb3b4eb0-0a05-443a-aea5-6cfbacfe6bde'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-96636c6c-e74f-454a-a0c8-3344ba3a7851 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-96636c6c-e74f-454a-a0c8-3344ba3a7851 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-96636c6c-e74f-454a-a0c8-3344ba3a7851 tempest-ProjectMemberTests-1299516133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-96636c6c-e74f-454a-a0c8-3344ba3a7851 tempest-ProjectMemberTests-1299516133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-96636c6c-e74f-454a-a0c8-3344ba3a7851 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-96636c6c-e74f-454a-a0c8-3344ba3a7851 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:53 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:53 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d1566478-4e10-4a56-a85c-c78d22e108ec tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa841490-fdb4-4b64-9cca-e55133d97074 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.fa002f37-bae7-4931-b6d8-aae729fb9a3a" returned: 0 in 0.376s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:53 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-d1566478-4e10-4a56-a85c-c78d22e108ec tempest-ProjectReaderTests-544844019 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.fa002f37-bae7-4931-b6d8-aae729fb9a3a is being set with open permissions: ugo+rw Sep 05 05:20:53 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d1566478-4e10-4a56-a85c-c78d22e108ec tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.fa002f37-bae7-4931-b6d8-aae729fb9a3a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:53 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.fa002f37-bae7-4931-b6d8-aae729fb9a3a Sep 05 05:20:53 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:53 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d1566478-4e10-4a56-a85c-c78d22e108ec tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.fa002f37-bae7-4931-b6d8-aae729fb9a3a" returned: 0 in 0.386s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d1566478-4e10-4a56-a85c-c78d22e108ec tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:53 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-96636c6c-e74f-454a-a0c8-3344ba3a7851 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.490s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:53 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.info Sep 05 05:20:53 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-96636c6c-e74f-454a-a0c8-3344ba3a7851 tempest-ProjectMemberTests-1299516133 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:53 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-96636c6c-e74f-454a-a0c8-3344ba3a7851 tempest-ProjectMemberTests-1299516133 None] Deleted volume successfully. Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-96636c6c-e74f-454a-a0c8-3344ba3a7851 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-b0c2b0cc-ae2d-47e6-bb8f-bc5f7862d9a1-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Flow 'volume_create_manager' (81d166fa-2e6e-499c-853c-15f526a88431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b52227-4c7a-4bce-a692-2d052dc84203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b52227-4c7a-4bce-a692-2d052dc84203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1265290440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee688d11-2cc3-4da9-9369-025bb08b458c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25cc6ded663e407a8e0d20fade20b428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:54Z,use_quota=True,user_id='bd4d0e7a35344484a4054a5f376ecd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61259d97-3c71-46cd-966f-6b8295fe38dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61259d97-3c71-46cd-966f-6b8295fe38dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107151e8-b2dc-4bfb-930f-87ac1d5523c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107151e8-b2dc-4bfb-930f-87ac1d5523c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee688d11-2cc3-4da9-9369-025bb08b458c', 'volume_name': 'volume-ee688d11-2cc3-4da9-9369-025bb08b458c', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94548a59-5b14-4662-ae6b-90a994e37539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94548a59-5b14-4662-ae6b-90a994e37539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:53 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a63fb3f-43d1-42b2-831d-c61eae05b4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:53 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Volume ee688d11-2cc3-4da9-9369-025bb08b458c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee688d11-2cc3-4da9-9369-025bb08b458c', 'volume_size': 1} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d1566478-4e10-4a56-a85c-c78d22e108ec tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.info" returned: 0 in 0.304s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:53 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-d1566478-4e10-4a56-a85c-c78d22e108ec tempest-ProjectReaderTests-544844019 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.info is being set with open permissions: ugo+rw Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d1566478-4e10-4a56-a85c-c78d22e108ec tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:53 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.info Sep 05 05:20:53 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Flow 'volume_create_manager' (27b18f69-3e6b-4436-bca3-01a7c45ba434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a25b02d-1cbc-4bc5-a725-ca2e6c9d628c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a25b02d-1cbc-4bc5-a725-ca2e6c9d628c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1007569542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad580cb1010b4899b3d6f4071f9a30c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:54Z,use_quota=True,user_id='777649d126094987b71ca3b21cd760a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8adb6f70-b1ea-4fb5-a33b-6ab6c1d57416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8adb6f70-b1ea-4fb5-a33b-6ab6c1d57416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8890737-89be-4f7b-bf58-196622fda2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8890737-89be-4f7b-bf58-196622fda2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc', 'volume_name': 'volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f1a2d78-2ede-41bb-8f3e-282422cc06a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f1a2d78-2ede-41bb-8f3e-282422cc06a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e2e5f8-9b22-4c72-9421-c93a0b93197b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:53 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Volume a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc', 'volume_size': 1} Sep 05 05:20:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:54 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d1566478-4e10-4a56-a85c-c78d22e108ec tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.info" returned: 0 in 0.255s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d1566478-4e10-4a56-a85c-c78d22e108ec tempest-ProjectReaderTests-544844019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.329s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.293s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1265290440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee688d11-2cc3-4da9-9369-025bb08b458c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25cc6ded663e407a8e0d20fade20b428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:54Z,use_quota=True,user_id='bd4d0e7a35344484a4054a5f376ecd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Creating volume ee688d11-2cc3-4da9-9369-025bb08b458c {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:54 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:54 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c 1073741824 Sep 05 05:20:54 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:54 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-d1566478-4e10-4a56-a85c-c78d22e108ec tempest-ProjectReaderTests-544844019 None] Create snapshot completed successfully Sep 05 05:20:54 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c 1073741824" returned: 0 in 0.472s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:54 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c Sep 05 05:20:54 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:54 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c" returned: 0 in 0.266s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.962s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1007569542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad580cb1010b4899b3d6f4071f9a30c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:54Z,use_quota=True,user_id='777649d126094987b71ca3b21cd760a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Creating volume a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:20:54 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:54 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc 1073741824 Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a63fb3f-43d1-42b2-831d-c61eae05b4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee688d11-2cc3-4da9-9369-025bb08b458c', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:54 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2da3ec0-e46b-442c-94be-405c43a03eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8490517e-14ad-41f0-9412-75f3624e102f tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-fa002f37-bae7-4931-b6d8-aae729fb9a3a-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:54 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Volume volume-ee688d11-2cc3-4da9-9369-025bb08b458c (ee688d11-2cc3-4da9-9369-025bb08b458c): created successfully Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2da3ec0-e46b-442c-94be-405c43a03eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Flow 'volume_create_manager' (81d166fa-2e6e-499c-853c-15f526a88431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8490517e-14ad-41f0-9412-75f3624e102f tempest-ProjectReaderTests-544844019 None] Lock "cinder-fa002f37-bae7-4931-b6d8-aae729fb9a3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8490517e-14ad-41f0-9412-75f3624e102f tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-quobyte-fa841490-fdb4-4b64-9cca-e55133d97074" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:54 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-5e3ab4ff-0612-4a68-a0c9-6e86ca7b1d24 tempest-VolumeDependencyTests-1832216537 None] Created volume successfully. Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8490517e-14ad-41f0-9412-75f3624e102f tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-fa841490-fdb4-4b64-9cca-e55133d97074" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8490517e-14ad-41f0-9412-75f3624e102f tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-quobyte-fa002f37-bae7-4931-b6d8-aae729fb9a3a" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8490517e-14ad-41f0-9412-75f3624e102f tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-fa002f37-bae7-4931-b6d8-aae729fb9a3a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-8490517e-14ad-41f0-9412-75f3624e102f tempest-ProjectReaderTests-544844019 None] Deleting offline snapshot fa002f37-bae7-4931-b6d8-aae729fb9a3a of volume fa841490-fdb4-4b64-9cca-e55133d97074 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-8490517e-14ad-41f0-9412-75f3624e102f tempest-ProjectReaderTests-544844019 None] snapshot_file for this snap is: volume-fa841490-fdb4-4b64-9cca-e55133d97074.fa002f37-bae7-4931-b6d8-aae729fb9a3a {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40612f5-1916-4074-9376-69a633c4b120]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8490517e-14ad-41f0-9412-75f3624e102f tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.fa002f37-bae7-4931-b6d8-aae729fb9a3a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:55 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.fa002f37-bae7-4931-b6d8-aae729fb9a3a Sep 05 05:20:55 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:55 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc 1073741824" returned: 0 in 0.530s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=255,cinder:UPDATE=331,cinder:INSERT=89,cinder:DELETE=28 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:55 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8490517e-14ad-41f0-9412-75f3624e102f tempest-ProjectReaderTests-544844019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.fa002f37-bae7-4931-b6d8-aae729fb9a3a" returned: 0 in 0.413s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-8490517e-14ad-41f0-9412-75f3624e102f tempest-ProjectReaderTests-544844019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa841490-fdb4-4b64-9cca-e55133d97074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:20:55 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc Sep 05 05:20:55 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd55036b-f999-4d53-9787-75ce163616e0]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8490517e-14ad-41f0-9412-75f3624e102f tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:55 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074 Sep 05 05:20:55 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:55 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc" returned: 0 in 0.356s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e2e5f8-9b22-4c72-9421-c93a0b93197b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3435fbdd-5537-482a-8773-b29b469fed27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=232,cinder:UPDATE=329,cinder:INSERT=89,cinder:DELETE=31 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:20:55 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Volume volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc (a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc): created successfully Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3435fbdd-5537-482a-8773-b29b469fed27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Flow 'volume_create_manager' (27b18f69-3e6b-4436-bca3-01a7c45ba434) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:55 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-30ed6aba-b8e1-4c21-80fb-6838d2b048ec tempest-ProjectMemberTests-1299516133 None] Created volume successfully. Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3d405785-7b2e-462c-9d1d-0e73707d8e43 tempest-VolumeDependencyTests-1832216537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3d405785-7b2e-462c-9d1d-0e73707d8e43 tempest-VolumeDependencyTests-1832216537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-3d405785-7b2e-462c-9d1d-0e73707d8e43 tempest-VolumeDependencyTests-1832216537 None] Creating offline snapshot 3d066c94-5a70-4ea7-8e37-91bb5e563fd6 of volume ee688d11-2cc3-4da9-9369-025bb08b458c {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:20:55 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8490517e-14ad-41f0-9412-75f3624e102f tempest-ProjectReaderTests-544844019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074" returned: 0 in 0.467s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8490517e-14ad-41f0-9412-75f3624e102f tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.fa002f37-bae7-4931-b6d8-aae729fb9a3a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ea6fe5-f035-4cf5-8ea3-6b38662bedd4]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d405785-7b2e-462c-9d1d-0e73707d8e43 tempest-VolumeDependencyTests-1832216537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:56 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.fa002f37-bae7-4931-b6d8-aae729fb9a3a Sep 05 05:20:56 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:56 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c Sep 05 05:20:56 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:56 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8490517e-14ad-41f0-9412-75f3624e102f tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.fa002f37-bae7-4931-b6d8-aae729fb9a3a" returned: 0 in 0.397s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8490517e-14ad-41f0-9412-75f3624e102f tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.fa002f37-bae7-4931-b6d8-aae729fb9a3a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:56 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:56 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.fa002f37-bae7-4931-b6d8-aae729fb9a3a Sep 05 05:20:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d405785-7b2e-462c-9d1d-0e73707d8e43 tempest-VolumeDependencyTests-1832216537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c" returned: 0 in 0.414s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:56 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d405785-7b2e-462c-9d1d-0e73707d8e43 tempest-VolumeDependencyTests-1832216537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.3d066c94-5a70-4ea7-8e37-91bb5e563fd6 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:56 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.3d066c94-5a70-4ea7-8e37-91bb5e563fd6 1G Sep 05 05:20:56 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:56 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8490517e-14ad-41f0-9412-75f3624e102f tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074.fa002f37-bae7-4931-b6d8-aae729fb9a3a" returned: 0 in 0.268s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8490517e-14ad-41f0-9412-75f3624e102f tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-fa002f37-bae7-4931-b6d8-aae729fb9a3a" released by "_delete_snapshot" :: held 1.672s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8490517e-14ad-41f0-9412-75f3624e102f tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-fa841490-fdb4-4b64-9cca-e55133d97074" released by "delete_snapshot" :: held 1.705s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:56 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-8490517e-14ad-41f0-9412-75f3624e102f tempest-ProjectReaderTests-544844019 None] Created reservations ['bda13d5a-66e3-4c55-b33c-64548cefa353', '7b7d4e27-eb5a-4de7-85fa-7cef276ffe51', '816139bb-e2e1-4dc7-8be0-025710a2a7ac', '2cb8f8a6-c6e5-4bbc-9139-c5ff9b572c85'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:56 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-8490517e-14ad-41f0-9412-75f3624e102f tempest-ProjectReaderTests-544844019 None] Delete snapshot completed successfully. Sep 05 05:20:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-8490517e-14ad-41f0-9412-75f3624e102f tempest-ProjectReaderTests-544844019 None] Lock "cinder-fa002f37-bae7-4931-b6d8-aae729fb9a3a-delete_snapshot" released by "delete_snapshot" :: held 1.865s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:56 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d405785-7b2e-462c-9d1d-0e73707d8e43 tempest-VolumeDependencyTests-1832216537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.3d066c94-5a70-4ea7-8e37-91bb5e563fd6 1G" returned: 0 in 0.469s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d405785-7b2e-462c-9d1d-0e73707d8e43 tempest-VolumeDependencyTests-1832216537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee688d11-2cc3-4da9-9369-025bb08b458c -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.3d066c94-5a70-4ea7-8e37-91bb5e563fd6 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:56 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee688d11-2cc3-4da9-9369-025bb08b458c -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.3d066c94-5a70-4ea7-8e37-91bb5e563fd6 Sep 05 05:20:56 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4e1ba0b0-fb54-4651-8785-b9d9164a239d tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-fa841490-fdb4-4b64-9cca-e55133d97074-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4e1ba0b0-fb54-4651-8785-b9d9164a239d tempest-ProjectReaderTests-544844019 None] Lock "cinder-fa841490-fdb4-4b64-9cca-e55133d97074-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4e1ba0b0-fb54-4651-8785-b9d9164a239d tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-quobyte-fa841490-fdb4-4b64-9cca-e55133d97074" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:20:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4e1ba0b0-fb54-4651-8785-b9d9164a239d tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-fa841490-fdb4-4b64-9cca-e55133d97074" acquired by "delete_volume" :: waited 0.024s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:20:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-207fa2a1-75be-470e-9add-91266fd35c32 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:57 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:57 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[be84f154-4863-45ff-aeda-8695046d8f9d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d405785-7b2e-462c-9d1d-0e73707d8e43 tempest-VolumeDependencyTests-1832216537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee688d11-2cc3-4da9-9369-025bb08b458c -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.3d066c94-5a70-4ea7-8e37-91bb5e563fd6" returned: 0 in 0.429s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4e1ba0b0-fb54-4651-8785-b9d9164a239d tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:57 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-3d405785-7b2e-462c-9d1d-0e73707d8e43 tempest-VolumeDependencyTests-1832216537 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.3d066c94-5a70-4ea7-8e37-91bb5e563fd6 is being set with open permissions: ugo+rw Sep 05 05:20:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d405785-7b2e-462c-9d1d-0e73707d8e43 tempest-VolumeDependencyTests-1832216537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.3d066c94-5a70-4ea7-8e37-91bb5e563fd6 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:57 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.3d066c94-5a70-4ea7-8e37-91bb5e563fd6 Sep 05 05:20:57 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:57 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074 Sep 05 05:20:57 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:57 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d405785-7b2e-462c-9d1d-0e73707d8e43 tempest-VolumeDependencyTests-1832216537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.3d066c94-5a70-4ea7-8e37-91bb5e563fd6" returned: 0 in 0.282s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d405785-7b2e-462c-9d1d-0e73707d8e43 tempest-VolumeDependencyTests-1832216537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:57 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.info Sep 05 05:20:57 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:57 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4e1ba0b0-fb54-4651-8785-b9d9164a239d tempest-ProjectReaderTests-544844019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074" returned: 0 in 0.395s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4e1ba0b0-fb54-4651-8785-b9d9164a239d tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:57 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074 Sep 05 05:20:57 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:57 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d405785-7b2e-462c-9d1d-0e73707d8e43 tempest-VolumeDependencyTests-1832216537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.info" returned: 0 in 0.307s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:57 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-3d405785-7b2e-462c-9d1d-0e73707d8e43 tempest-VolumeDependencyTests-1832216537 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.info is being set with open permissions: ugo+rw Sep 05 05:20:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d405785-7b2e-462c-9d1d-0e73707d8e43 tempest-VolumeDependencyTests-1832216537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:57 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4e1ba0b0-fb54-4651-8785-b9d9164a239d tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-fa841490-fdb4-4b64-9cca-e55133d97074" returned: 0 in 0.265s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:57 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.info Sep 05 05:20:57 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4e1ba0b0-fb54-4651-8785-b9d9164a239d tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-fa841490-fdb4-4b64-9cca-e55133d97074" released by "delete_volume" :: held 0.731s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-4e1ba0b0-fb54-4651-8785-b9d9164a239d tempest-ProjectReaderTests-544844019 None] Created reservations ['d829fa3a-906e-4cc9-a2cf-d4f62000b4f2', 'c4a3b991-df9d-4454-aad1-a09b4d608c8e', 'e6321a74-a194-40b2-b79d-824ad25d064b', '87f25995-6c89-4580-9516-83f6f908ac97'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4e1ba0b0-fb54-4651-8785-b9d9164a239d tempest-ProjectReaderTests-544844019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4e1ba0b0-fb54-4651-8785-b9d9164a239d tempest-ProjectReaderTests-544844019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4e1ba0b0-fb54-4651-8785-b9d9164a239d tempest-ProjectReaderTests-544844019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4e1ba0b0-fb54-4651-8785-b9d9164a239d tempest-ProjectReaderTests-544844019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4e1ba0b0-fb54-4651-8785-b9d9164a239d tempest-ProjectReaderTests-544844019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4e1ba0b0-fb54-4651-8785-b9d9164a239d tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:58 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:20:58 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:58 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3d405785-7b2e-462c-9d1d-0e73707d8e43 tempest-VolumeDependencyTests-1832216537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.info" returned: 0 in 0.297s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3d405785-7b2e-462c-9d1d-0e73707d8e43 tempest-VolumeDependencyTests-1832216537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.313s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-207fa2a1-75be-470e-9add-91266fd35c32 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.977s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-207fa2a1-75be-470e-9add-91266fd35c32 tempest-ProjectMemberTests-1299516133 None] Creating offline snapshot 88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda of volume a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:20:58 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-3d405785-7b2e-462c-9d1d-0e73707d8e43 tempest-VolumeDependencyTests-1832216537 None] Create snapshot completed successfully Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7801b515-3575-4ba4-ac33-db66e819f97b]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-207fa2a1-75be-470e-9add-91266fd35c32 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:58 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc Sep 05 05:20:58 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:58 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4e1ba0b0-fb54-4651-8785-b9d9164a239d tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.350s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-4e1ba0b0-fb54-4651-8785-b9d9164a239d tempest-ProjectReaderTests-544844019 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:20:58 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-4e1ba0b0-fb54-4651-8785-b9d9164a239d tempest-ProjectReaderTests-544844019 None] Deleted volume successfully. Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-4e1ba0b0-fb54-4651-8785-b9d9164a239d tempest-ProjectReaderTests-544844019 None] Lock "cinder-fa841490-fdb4-4b64-9cca-e55133d97074-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:20:58 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-207fa2a1-75be-470e-9add-91266fd35c32 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc" returned: 0 in 0.523s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-207fa2a1-75be-470e-9add-91266fd35c32 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:58 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda 1G Sep 05 05:20:58 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Flow 'volume_create_manager' (12add2e6-b4d9-4e00-af62-448608187289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf907bc-5d2c-43a5-8470-dc37a028da78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf907bc-5d2c-43a5-8470-dc37a028da78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-704574229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=881a3a00-e782-4d1c-8a7d-6bbebd14b782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddcd468ba4ee4f31ad43c9f153ba3f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:59Z,use_quota=True,user_id='5d90352309854303aa9a3d8d5110463e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1534494c-29e6-48df-bcb7-afe65d425a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1534494c-29e6-48df-bcb7-afe65d425a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da963fc1-c89b-42ec-aa80-62f99f8d2de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da963fc1-c89b-42ec-aa80-62f99f8d2de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '881a3a00-e782-4d1c-8a7d-6bbebd14b782', 'volume_name': 'volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac034235-dc88-4b43-89cc-4548dcb71818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac034235-dc88-4b43-89cc-4548dcb71818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44044bf7-04af-4cc6-8316-7c833ee9e8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:59 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Volume 881a3a00-e782-4d1c-8a7d-6bbebd14b782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782', 'volume_size': 1} Sep 05 05:20:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:59 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-207fa2a1-75be-470e-9add-91266fd35c32 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda 1G" returned: 0 in 0.495s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-207fa2a1-75be-470e-9add-91266fd35c32 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:59 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda Sep 05 05:20:59 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:59 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-207fa2a1-75be-470e-9add-91266fd35c32 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda" returned: 0 in 0.340s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:59 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-207fa2a1-75be-470e-9add-91266fd35c32 tempest-ProjectMemberTests-1299516133 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda is being set with open permissions: ugo+rw Sep 05 05:20:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-207fa2a1-75be-470e-9add-91266fd35c32 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:59 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda Sep 05 05:20:59 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:20:59 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:20:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Flow 'volume_create_manager' (f40bbb70-cd8e-40d1-8113-f473c839e6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:20:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60332c44-110f-487f-a0d6-c348ccd5f328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60332c44-110f-487f-a0d6-c348ccd5f328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-458362634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7b8359-0eed-439c-b19b-5c4547020b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25cc6ded663e407a8e0d20fade20b428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3d066c94-5a70-4ea7-8e37-91bb5e563fd6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:00Z,use_quota=True,user_id='bd4d0e7a35344484a4054a5f376ecd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d5522f7-2de1-4de7-9e31-76ee9cfb420a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d5522f7-2de1-4de7-9e31-76ee9cfb420a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120fe95d-90d1-4515-bf27-1107aa4415ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120fe95d-90d1-4515-bf27-1107aa4415ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7b7b8359-0eed-439c-b19b-5c4547020b34', 'volume_name': 'volume-7b7b8359-0eed-439c-b19b-5c4547020b34', 'volume_size': 1, 'snapshot_id': '3d066c94-5a70-4ea7-8e37-91bb5e563fd6'}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dab7e17-a185-4ae0-b0f1-cdf0852c4bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dab7e17-a185-4ae0-b0f1-cdf0852c4bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:20:59 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4e3bab-fb33-4b67-bf13-8b70397e403a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:20:59 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Volume 7b7b8359-0eed-439c-b19b-5c4547020b34: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7b7b8359-0eed-439c-b19b-5c4547020b34', 'volume_size': 1, 'snapshot_id': '3d066c94-5a70-4ea7-8e37-91bb5e563fd6'} Sep 05 05:20:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:20:59 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 05 05:20:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-207fa2a1-75be-470e-9add-91266fd35c32 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda" returned: 0 in 0.245s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:20:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-207fa2a1-75be-470e-9add-91266fd35c32 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:20:59 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.info Sep 05 05:20:59 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:00 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-207fa2a1-75be-470e-9add-91266fd35c32 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.info" returned: 0 in 0.274s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:00 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-207fa2a1-75be-470e-9add-91266fd35c32 tempest-ProjectMemberTests-1299516133 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.info is being set with open permissions: ugo+rw Sep 05 05:21:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-207fa2a1-75be-470e-9add-91266fd35c32 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:00 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.info Sep 05 05:21:00 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:00 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-207fa2a1-75be-470e-9add-91266fd35c32 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.info" returned: 0 in 0.261s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-207fa2a1-75be-470e-9add-91266fd35c32 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.237s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.488s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:00 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-704574229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=881a3a00-e782-4d1c-8a7d-6bbebd14b782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddcd468ba4ee4f31ad43c9f153ba3f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:20:59Z,use_quota=True,user_id='5d90352309854303aa9a3d8d5110463e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:21:00 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Creating volume 881a3a00-e782-4d1c-8a7d-6bbebd14b782 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:21:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:00 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:00 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:00 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:21:00 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:21:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:00 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782 1073741824 Sep 05 05:21:00 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:00 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-207fa2a1-75be-470e-9add-91266fd35c32 tempest-ProjectMemberTests-1299516133 None] Create snapshot completed successfully Sep 05 05:21:00 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782 1073741824" returned: 0 in 0.472s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:01 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782 Sep 05 05:21:01 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:01 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782" returned: 0 in 0.290s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.437s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Acquiring lock "cinder-quobyte-3d066c94-5a70-4ea7-8e37-91bb5e563fd6-7b7b8359-0eed-439c-b19b-5c4547020b34" by "_create_volume_from_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44044bf7-04af-4cc6-8316-7c833ee9e8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6473537-867f-4033-b811-ae234edbc358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Lock "cinder-quobyte-3d066c94-5a70-4ea7-8e37-91bb5e563fd6-7b7b8359-0eed-439c-b19b-5c4547020b34" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Creating volume 7b7b8359-0eed-439c-b19b-5c4547020b34 from snapshot 3d066c94-5a70-4ea7-8e37-91bb5e563fd6 {{(pid=89331) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Acquiring lock "cinder-quobyte-7b7b8359-0eed-439c-b19b-5c4547020b34" by "_copy_volume_from_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:01 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Volume volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782 (881a3a00-e782-4d1c-8a7d-6bbebd14b782): created successfully Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6473537-867f-4033-b811-ae234edbc358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Flow 'volume_create_manager' (12add2e6-b4d9-4e00-af62-448608187289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:01 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-a74d3cfb-bde8-49d6-a70d-2514cf5f6e8e tempest-ProjectReaderTests-544844019 None] Created volume successfully. Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Lock "cinder-quobyte-7b7b8359-0eed-439c-b19b-5c4547020b34" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] snapshot: 3d066c94-5a70-4ea7-8e37-91bb5e563fd6, volume: 7b7b8359-0eed-439c-b19b-5c4547020b34, {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-88c979ab-3f58-4015-9061-60a5f6141870 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2870e40e-7e96-4494-bb26-4583f5616f9e]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.3d066c94-5a70-4ea7-8e37-91bb5e563fd6 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-88c979ab-3f58-4015-9061-60a5f6141870 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-88c979ab-3f58-4015-9061-60a5f6141870 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-88c979ab-3f58-4015-9061-60a5f6141870 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-88c979ab-3f58-4015-9061-60a5f6141870 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-88c979ab-3f58-4015-9061-60a5f6141870 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-88c979ab-3f58-4015-9061-60a5f6141870 tempest-ProjectMemberTests-1299516133 None] Deleting offline snapshot 88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda of volume a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-88c979ab-3f58-4015-9061-60a5f6141870 tempest-ProjectMemberTests-1299516133 None] snapshot_file for this snap is: volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e0c9a5-ab7b-4f9b-9eba-ee4356a71a13]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-88c979ab-3f58-4015-9061-60a5f6141870 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:01 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.3d066c94-5a70-4ea7-8e37-91bb5e563fd6 Sep 05 05:21:01 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:01 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda Sep 05 05:21:01 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:01 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.3d066c94-5a70-4ea7-8e37-91bb5e563fd6" returned: 0 in 0.478s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee688d11-2cc3-4da9-9369-025bb08b458c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cee61d7-7852-49aa-8747-d3e800762d7e]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:01 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-88c979ab-3f58-4015-9061-60a5f6141870 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda" returned: 0 in 0.415s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-88c979ab-3f58-4015-9061-60a5f6141870 tempest-ProjectMemberTests-1299516133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:21:02 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[da60bd30-9bf0-4d08-add8-a898ccf0b41d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-88c979ab-3f58-4015-9061-60a5f6141870 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:02 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c Sep 05 05:21:02 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:02 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc Sep 05 05:21:02 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-50e9bb9a-7eb8-47eb-83c5-b79cd578cfa6 tempest-ProjectReaderTests-544844019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:02 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c" returned: 0 in 0.445s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 05:21:02 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Creating direct copy from snapshot {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 05:21:02 devstack cinder-volume[89331]: DEBUG cinder.utils [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Path /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b7b8359-0eed-439c-b19b-5c4547020b34 not found in is_blk_device check {{(pid=89331) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 05:21:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b7b8359-0eed-439c-b19b-5c4547020b34 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:02 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b7b8359-0eed-439c-b19b-5c4547020b34 Sep 05 05:21:02 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:02 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-88c979ab-3f58-4015-9061-60a5f6141870 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc" returned: 0 in 0.580s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-88c979ab-3f58-4015-9061-60a5f6141870 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:02 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda Sep 05 05:21:02 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:03 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-88c979ab-3f58-4015-9061-60a5f6141870 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda" returned: 0 in 0.398s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-88c979ab-3f58-4015-9061-60a5f6141870 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:03 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda Sep 05 05:21:03 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:03 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-88c979ab-3f58-4015-9061-60a5f6141870 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc.88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda" returned: 0 in 0.522s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-88c979ab-3f58-4015-9061-60a5f6141870 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda" released by "_delete_snapshot" :: held 2.139s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-88c979ab-3f58-4015-9061-60a5f6141870 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc" released by "delete_snapshot" :: held 2.181s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:03 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-88c979ab-3f58-4015-9061-60a5f6141870 tempest-ProjectMemberTests-1299516133 None] Created reservations ['a2ab77f0-5b89-4a8e-94a6-41f5d81a4b09', '31f8ecd0-87fe-4fe4-9210-d6c2ab4f1e24', 'a45064e7-382a-4db3-99fd-d772b5632c6c', '357b4568-76b7-42c7-aaf2-374f4ed3eb53'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:04 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-88c979ab-3f58-4015-9061-60a5f6141870 tempest-ProjectMemberTests-1299516133 None] Delete snapshot completed successfully. Sep 05 05:21:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-88c979ab-3f58-4015-9061-60a5f6141870 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-88c1ba58-5b6e-4fb6-ab45-2cdbcfb16cda-delete_snapshot" released by "delete_snapshot" :: held 2.637s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-404a5786-e203-4056-a30b-4817c7f3b26f tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-404a5786-e203-4056-a30b-4817c7f3b26f tempest-ProjectMemberTests-1299516133 None] Lock "cinder-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-404a5786-e203-4056-a30b-4817c7f3b26f tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:05 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-404a5786-e203-4056-a30b-4817c7f3b26f tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc" acquired by "delete_volume" :: waited 0.054s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:05 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a383b158-517c-4ae2-a684-e587a2faf5ab]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-404a5786-e203-4056-a30b-4817c7f3b26f tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:05 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc Sep 05 05:21:05 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:05 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-404a5786-e203-4056-a30b-4817c7f3b26f tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc" returned: 0 in 0.657s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-404a5786-e203-4056-a30b-4817c7f3b26f tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:06 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc Sep 05 05:21:06 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:06 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-404a5786-e203-4056-a30b-4817c7f3b26f tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc" returned: 0 in 0.450s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:06 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-404a5786-e203-4056-a30b-4817c7f3b26f tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc" released by "delete_volume" :: held 1.260s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:06 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-404a5786-e203-4056-a30b-4817c7f3b26f tempest-ProjectMemberTests-1299516133 None] Created reservations ['9a76881b-e3dd-4ad3-8f2a-4ff8d7f05d8c', '43250e90-1c72-40ee-b4d1-cceaba78dcc0', 'dc75e158-1aa7-415f-82ad-66cb5ff725b9', '522eb6e9-e818-4711-a3b1-fbc2e981b723'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-404a5786-e203-4056-a30b-4817c7f3b26f tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-404a5786-e203-4056-a30b-4817c7f3b26f tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-404a5786-e203-4056-a30b-4817c7f3b26f tempest-ProjectMemberTests-1299516133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-404a5786-e203-4056-a30b-4817c7f3b26f tempest-ProjectMemberTests-1299516133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-404a5786-e203-4056-a30b-4817c7f3b26f tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-404a5786-e203-4056-a30b-4817c7f3b26f tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:06 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:21:06 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:07 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-404a5786-e203-4056-a30b-4817c7f3b26f tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.704s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:07 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-404a5786-e203-4056-a30b-4817c7f3b26f tempest-ProjectMemberTests-1299516133 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:21:07 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-404a5786-e203-4056-a30b-4817c7f3b26f tempest-ProjectMemberTests-1299516133 None] Deleted volume successfully. Sep 05 05:21:07 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-404a5786-e203-4056-a30b-4817c7f3b26f tempest-ProjectMemberTests-1299516133 None] Lock "cinder-a4cfe3ae-f9c7-48eb-8a40-04bdce6b02fc-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:07 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b7b8359-0eed-439c-b19b-5c4547020b34" returned: 0 in 5.352s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:07 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c, size 1024.00 MB, duration 5.35 sec, destination /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b7b8359-0eed-439c-b19b-5c4547020b34 {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:21:07 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Converted 1024.00 MB image at 191.30 MB/s Sep 05 05:21:07 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b7b8359-0eed-439c-b19b-5c4547020b34 is being set with open permissions: ugo+rw Sep 05 05:21:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b7b8359-0eed-439c-b19b-5c4547020b34 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:07 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b7b8359-0eed-439c-b19b-5c4547020b34 Sep 05 05:21:07 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:08 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b7b8359-0eed-439c-b19b-5c4547020b34" returned: 0 in 0.313s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Lock "cinder-quobyte-7b7b8359-0eed-439c-b19b-5c4547020b34" released by "_copy_volume_from_snapshot" :: held 6.705s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Lock "cinder-quobyte-3d066c94-5a70-4ea7-8e37-91bb5e563fd6-7b7b8359-0eed-439c-b19b-5c4547020b34" released by "_create_volume_from_snapshot" :: held 6.827s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.870s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-50e9bb9a-7eb8-47eb-83c5-b79cd578cfa6 tempest-ProjectReaderTests-544844019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.890s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-50e9bb9a-7eb8-47eb-83c5-b79cd578cfa6 tempest-ProjectReaderTests-544844019 None] Creating offline snapshot 823bcd59-45d0-4b37-a9fb-5ab7adea6b75 of volume 881a3a00-e782-4d1c-8a7d-6bbebd14b782 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8200db2c-2e2e-4d04-b2a6-6ec6466000a0]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-50e9bb9a-7eb8-47eb-83c5-b79cd578cfa6 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4e3bab-fb33-4b67-bf13-8b70397e403a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b7b8359-0eed-439c-b19b-5c4547020b34', 'volume_size': 1, 'snapshot_id': '3d066c94-5a70-4ea7-8e37-91bb5e563fd6'}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2539a299-33bd-40f7-8302-37d5c0ab0139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Flow 'volume_create_manager' (f9cbfd2e-de15-414c-8c86-da87c7751626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e74a420d-9f30-485e-950e-82bd2ff94649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:08 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Volume volume-7b7b8359-0eed-439c-b19b-5c4547020b34 (7b7b8359-0eed-439c-b19b-5c4547020b34): created successfully Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2539a299-33bd-40f7-8302-37d5c0ab0139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Flow 'volume_create_manager' (f40bbb70-cd8e-40d1-8113-f473c839e6a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e74a420d-9f30-485e-950e-82bd2ff94649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-850495496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b128dd-e286-4e16-a512-8ea20f46cb86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad580cb1010b4899b3d6f4071f9a30c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:08Z,use_quota=True,user_id='777649d126094987b71ca3b21cd760a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc1c548-7752-46ff-9028-f617b89ae047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc1c548-7752-46ff-9028-f617b89ae047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20835ff5-ec24-40d4-ad3f-3eba86508b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20835ff5-ec24-40d4-ad3f-3eba86508b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74b128dd-e286-4e16-a512-8ea20f46cb86', 'volume_name': 'volume-74b128dd-e286-4e16-a512-8ea20f46cb86', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07fb0f6a-9119-4444-93c5-83a2af9e97e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07fb0f6a-9119-4444-93c5-83a2af9e97e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54852869-c524-4423-9950-328bcf145359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:08 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782 Sep 05 05:21:08 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Volume 74b128dd-e286-4e16-a512-8ea20f46cb86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74b128dd-e286-4e16-a512-8ea20f46cb86', 'volume_size': 1} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:08 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:08 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-097d53dd-bca4-4e6c-a90f-15d6ee5a1507 tempest-VolumeDependencyTests-1832216537 None] Created volume successfully. Sep 05 05:21:08 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-50e9bb9a-7eb8-47eb-83c5-b79cd578cfa6 tempest-ProjectReaderTests-544844019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782" returned: 0 in 0.449s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-50e9bb9a-7eb8-47eb-83c5-b79cd578cfa6 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.823bcd59-45d0-4b37-a9fb-5ab7adea6b75 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:08 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.823bcd59-45d0-4b37-a9fb-5ab7adea6b75 1G Sep 05 05:21:08 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f259a0a9-5521-4bb1-859a-5813aba14b32 tempest-VolumeDependencyTests-1832216537 None] Acquiring lock "cinder-3d066c94-5a70-4ea7-8e37-91bb5e563fd6-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f259a0a9-5521-4bb1-859a-5813aba14b32 tempest-VolumeDependencyTests-1832216537 None] Lock "cinder-3d066c94-5a70-4ea7-8e37-91bb5e563fd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f259a0a9-5521-4bb1-859a-5813aba14b32 tempest-VolumeDependencyTests-1832216537 None] Acquiring lock "cinder-quobyte-ee688d11-2cc3-4da9-9369-025bb08b458c" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f259a0a9-5521-4bb1-859a-5813aba14b32 tempest-VolumeDependencyTests-1832216537 None] Lock "cinder-quobyte-ee688d11-2cc3-4da9-9369-025bb08b458c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f259a0a9-5521-4bb1-859a-5813aba14b32 tempest-VolumeDependencyTests-1832216537 None] Acquiring lock "cinder-quobyte-3d066c94-5a70-4ea7-8e37-91bb5e563fd6" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f259a0a9-5521-4bb1-859a-5813aba14b32 tempest-VolumeDependencyTests-1832216537 None] Lock "cinder-quobyte-3d066c94-5a70-4ea7-8e37-91bb5e563fd6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-f259a0a9-5521-4bb1-859a-5813aba14b32 tempest-VolumeDependencyTests-1832216537 None] Deleting offline snapshot 3d066c94-5a70-4ea7-8e37-91bb5e563fd6 of volume ee688d11-2cc3-4da9-9369-025bb08b458c {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-f259a0a9-5521-4bb1-859a-5813aba14b32 tempest-VolumeDependencyTests-1832216537 None] snapshot_file for this snap is: volume-ee688d11-2cc3-4da9-9369-025bb08b458c.3d066c94-5a70-4ea7-8e37-91bb5e563fd6 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6782e588-c609-4dd1-adfe-a96842685dca]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f259a0a9-5521-4bb1-859a-5813aba14b32 tempest-VolumeDependencyTests-1832216537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.3d066c94-5a70-4ea7-8e37-91bb5e563fd6 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:08 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.3d066c94-5a70-4ea7-8e37-91bb5e563fd6 Sep 05 05:21:08 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:09 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-50e9bb9a-7eb8-47eb-83c5-b79cd578cfa6 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.823bcd59-45d0-4b37-a9fb-5ab7adea6b75 1G" returned: 0 in 0.454s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-50e9bb9a-7eb8-47eb-83c5-b79cd578cfa6 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.823bcd59-45d0-4b37-a9fb-5ab7adea6b75 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:09 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.823bcd59-45d0-4b37-a9fb-5ab7adea6b75 Sep 05 05:21:09 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:09 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f259a0a9-5521-4bb1-859a-5813aba14b32 tempest-VolumeDependencyTests-1832216537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.3d066c94-5a70-4ea7-8e37-91bb5e563fd6" returned: 0 in 0.464s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:09 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-f259a0a9-5521-4bb1-859a-5813aba14b32 tempest-VolumeDependencyTests-1832216537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee688d11-2cc3-4da9-9369-025bb08b458c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:21:09 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[138dbe8f-6f3a-40b2-a088-887af78ce20c]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f259a0a9-5521-4bb1-859a-5813aba14b32 tempest-VolumeDependencyTests-1832216537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:09 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c Sep 05 05:21:09 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:09 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-50e9bb9a-7eb8-47eb-83c5-b79cd578cfa6 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.823bcd59-45d0-4b37-a9fb-5ab7adea6b75" returned: 0 in 0.385s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:09 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-50e9bb9a-7eb8-47eb-83c5-b79cd578cfa6 tempest-ProjectReaderTests-544844019 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.823bcd59-45d0-4b37-a9fb-5ab7adea6b75 is being set with open permissions: ugo+rw Sep 05 05:21:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-50e9bb9a-7eb8-47eb-83c5-b79cd578cfa6 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.823bcd59-45d0-4b37-a9fb-5ab7adea6b75 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:09 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.823bcd59-45d0-4b37-a9fb-5ab7adea6b75 Sep 05 05:21:09 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:09 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-50e9bb9a-7eb8-47eb-83c5-b79cd578cfa6 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.823bcd59-45d0-4b37-a9fb-5ab7adea6b75" returned: 0 in 0.291s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-50e9bb9a-7eb8-47eb-83c5-b79cd578cfa6 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:09 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.info Sep 05 05:21:09 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:09 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f259a0a9-5521-4bb1-859a-5813aba14b32 tempest-VolumeDependencyTests-1832216537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c" returned: 0 in 0.631s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f259a0a9-5521-4bb1-859a-5813aba14b32 tempest-VolumeDependencyTests-1832216537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.3d066c94-5a70-4ea7-8e37-91bb5e563fd6 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:09 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.3d066c94-5a70-4ea7-8e37-91bb5e563fd6 Sep 05 05:21:09 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:10 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-50e9bb9a-7eb8-47eb-83c5-b79cd578cfa6 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.info" returned: 0 in 0.304s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:10 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-50e9bb9a-7eb8-47eb-83c5-b79cd578cfa6 tempest-ProjectReaderTests-544844019 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.info is being set with open permissions: ugo+rw Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-50e9bb9a-7eb8-47eb-83c5-b79cd578cfa6 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:10 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.info Sep 05 05:21:10 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:10 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f259a0a9-5521-4bb1-859a-5813aba14b32 tempest-VolumeDependencyTests-1832216537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.3d066c94-5a70-4ea7-8e37-91bb5e563fd6" returned: 0 in 0.390s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f259a0a9-5521-4bb1-859a-5813aba14b32 tempest-VolumeDependencyTests-1832216537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.3d066c94-5a70-4ea7-8e37-91bb5e563fd6 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:10 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.3d066c94-5a70-4ea7-8e37-91bb5e563fd6 Sep 05 05:21:10 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:10 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-50e9bb9a-7eb8-47eb-83c5-b79cd578cfa6 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.info" returned: 0 in 0.258s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-50e9bb9a-7eb8-47eb-83c5-b79cd578cfa6 tempest-ProjectReaderTests-544844019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.254s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.076s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-850495496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b128dd-e286-4e16-a512-8ea20f46cb86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad580cb1010b4899b3d6f4071f9a30c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:08Z,use_quota=True,user_id='777649d126094987b71ca3b21cd760a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Creating volume 74b128dd-e286-4e16-a512-8ea20f46cb86 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:21:10 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:10 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86 1073741824 Sep 05 05:21:10 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:10 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-50e9bb9a-7eb8-47eb-83c5-b79cd578cfa6 tempest-ProjectReaderTests-544844019 None] Create snapshot completed successfully Sep 05 05:21:10 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f259a0a9-5521-4bb1-859a-5813aba14b32 tempest-VolumeDependencyTests-1832216537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c.3d066c94-5a70-4ea7-8e37-91bb5e563fd6" returned: 0 in 0.298s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f259a0a9-5521-4bb1-859a-5813aba14b32 tempest-VolumeDependencyTests-1832216537 None] Lock "cinder-quobyte-3d066c94-5a70-4ea7-8e37-91bb5e563fd6" released by "_delete_snapshot" :: held 1.893s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f259a0a9-5521-4bb1-859a-5813aba14b32 tempest-VolumeDependencyTests-1832216537 None] Lock "cinder-quobyte-ee688d11-2cc3-4da9-9369-025bb08b458c" released by "delete_snapshot" :: held 1.921s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-f259a0a9-5521-4bb1-859a-5813aba14b32 tempest-VolumeDependencyTests-1832216537 None] Created reservations ['4a21071a-2eef-4030-8a02-88c2de54cebe', '9b1f066e-824e-4b04-91ce-d85906ab5f9f', 'b82e4bd7-7de2-46e1-98f0-ce9f961052d9', '6d200c8b-1f60-49f8-9115-5eacd3200e77'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:10 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-f259a0a9-5521-4bb1-859a-5813aba14b32 tempest-VolumeDependencyTests-1832216537 None] Delete snapshot completed successfully. Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f259a0a9-5521-4bb1-859a-5813aba14b32 tempest-VolumeDependencyTests-1832216537 None] Lock "cinder-3d066c94-5a70-4ea7-8e37-91bb5e563fd6-delete_snapshot" released by "delete_snapshot" :: held 2.089s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f6ebb313-089e-4902-bb1b-3f20aa3a644f tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-823bcd59-45d0-4b37-a9fb-5ab7adea6b75-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-aafaba68-7d11-4448-812d-2c0d2ec70ccf tempest-VolumeDependencyTests-1832216537 None] Acquiring lock "cinder-ee688d11-2cc3-4da9-9369-025bb08b458c-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f6ebb313-089e-4902-bb1b-3f20aa3a644f tempest-ProjectReaderTests-544844019 None] Lock "cinder-823bcd59-45d0-4b37-a9fb-5ab7adea6b75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f6ebb313-089e-4902-bb1b-3f20aa3a644f tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-quobyte-881a3a00-e782-4d1c-8a7d-6bbebd14b782" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-aafaba68-7d11-4448-812d-2c0d2ec70ccf tempest-VolumeDependencyTests-1832216537 None] Lock "cinder-ee688d11-2cc3-4da9-9369-025bb08b458c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f6ebb313-089e-4902-bb1b-3f20aa3a644f tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-881a3a00-e782-4d1c-8a7d-6bbebd14b782" acquired by "delete_snapshot" :: waited 0.034s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f6ebb313-089e-4902-bb1b-3f20aa3a644f tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-quobyte-823bcd59-45d0-4b37-a9fb-5ab7adea6b75" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f6ebb313-089e-4902-bb1b-3f20aa3a644f tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-823bcd59-45d0-4b37-a9fb-5ab7adea6b75" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-f6ebb313-089e-4902-bb1b-3f20aa3a644f tempest-ProjectReaderTests-544844019 None] Deleting offline snapshot 823bcd59-45d0-4b37-a9fb-5ab7adea6b75 of volume 881a3a00-e782-4d1c-8a7d-6bbebd14b782 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:21:11 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-f6ebb313-089e-4902-bb1b-3f20aa3a644f tempest-ProjectReaderTests-544844019 None] snapshot_file for this snap is: volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.823bcd59-45d0-4b37-a9fb-5ab7adea6b75 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86 1073741824" returned: 0 in 0.634s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f00ee6-c773-45f5-a87c-d13a4471e5be]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f6ebb313-089e-4902-bb1b-3f20aa3a644f tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.823bcd59-45d0-4b37-a9fb-5ab7adea6b75 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-aafaba68-7d11-4448-812d-2c0d2ec70ccf tempest-VolumeDependencyTests-1832216537 None] Acquiring lock "cinder-quobyte-ee688d11-2cc3-4da9-9369-025bb08b458c" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-aafaba68-7d11-4448-812d-2c0d2ec70ccf tempest-VolumeDependencyTests-1832216537 None] Lock "cinder-quobyte-ee688d11-2cc3-4da9-9369-025bb08b458c" acquired by "delete_volume" :: waited 0.028s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bce2de8-f4db-4496-8ec8-fa0af837b86e]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aafaba68-7d11-4448-812d-2c0d2ec70ccf tempest-VolumeDependencyTests-1832216537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:11 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.823bcd59-45d0-4b37-a9fb-5ab7adea6b75 Sep 05 05:21:11 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86 Sep 05 05:21:11 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:11 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:11 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c Sep 05 05:21:11 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:11 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86" returned: 0 in 0.348s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:11 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f6ebb313-089e-4902-bb1b-3f20aa3a644f tempest-ProjectReaderTests-544844019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.823bcd59-45d0-4b37-a9fb-5ab7adea6b75" returned: 0 in 0.445s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-f6ebb313-089e-4902-bb1b-3f20aa3a644f tempest-ProjectReaderTests-544844019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54852869-c524-4423-9950-328bcf145359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74b128dd-e286-4e16-a512-8ea20f46cb86', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8b6aaa-fb13-4edc-8388-7cb145455d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6386a1f-3ad5-4caa-8a2e-9d0a2c99b0c6]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f6ebb313-089e-4902-bb1b-3f20aa3a644f tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:11 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Volume volume-74b128dd-e286-4e16-a512-8ea20f46cb86 (74b128dd-e286-4e16-a512-8ea20f46cb86): created successfully Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8b6aaa-fb13-4edc-8388-7cb145455d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Flow 'volume_create_manager' (f9cbfd2e-de15-414c-8c86-da87c7751626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:11 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-4eee7bc5-e1b4-4d15-971f-f631cfa77ab5 tempest-ProjectMemberTests-1299516133 None] Created volume successfully. Sep 05 05:21:11 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aafaba68-7d11-4448-812d-2c0d2ec70ccf tempest-VolumeDependencyTests-1832216537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c" returned: 0 in 0.457s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aafaba68-7d11-4448-812d-2c0d2ec70ccf tempest-VolumeDependencyTests-1832216537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:11 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c Sep 05 05:21:11 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:11 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782 Sep 05 05:21:11 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:11 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aafaba68-7d11-4448-812d-2c0d2ec70ccf tempest-VolumeDependencyTests-1832216537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ee688d11-2cc3-4da9-9369-025bb08b458c" returned: 0 in 0.260s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-aafaba68-7d11-4448-812d-2c0d2ec70ccf tempest-VolumeDependencyTests-1832216537 None] Lock "cinder-quobyte-ee688d11-2cc3-4da9-9369-025bb08b458c" released by "delete_volume" :: held 0.798s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-aafaba68-7d11-4448-812d-2c0d2ec70ccf tempest-VolumeDependencyTests-1832216537 None] Created reservations ['519f2126-aeb0-4d1d-a09e-8a4348fd8de4', '12ed73e9-b010-47bd-8726-999a85407c07', '48aed9ec-3491-4c33-b687-5f7c66945e42', '9fc38d8d-2ab1-47a2-b814-aac5a41f452c'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:12 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f6ebb313-089e-4902-bb1b-3f20aa3a644f tempest-ProjectReaderTests-544844019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782" returned: 0 in 0.426s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f6ebb313-089e-4902-bb1b-3f20aa3a644f tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.823bcd59-45d0-4b37-a9fb-5ab7adea6b75 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:12 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.823bcd59-45d0-4b37-a9fb-5ab7adea6b75 Sep 05 05:21:12 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-aafaba68-7d11-4448-812d-2c0d2ec70ccf tempest-VolumeDependencyTests-1832216537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-aafaba68-7d11-4448-812d-2c0d2ec70ccf tempest-VolumeDependencyTests-1832216537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-aafaba68-7d11-4448-812d-2c0d2ec70ccf tempest-VolumeDependencyTests-1832216537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-aafaba68-7d11-4448-812d-2c0d2ec70ccf tempest-VolumeDependencyTests-1832216537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-aafaba68-7d11-4448-812d-2c0d2ec70ccf tempest-VolumeDependencyTests-1832216537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aafaba68-7d11-4448-812d-2c0d2ec70ccf tempest-VolumeDependencyTests-1832216537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:12 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:21:12 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0a848c68-7b11-4e42-856c-f500c457066a tempest-VolumeDependencyTests-1832216537 None] Acquiring lock "cinder-7b7b8359-0eed-439c-b19b-5c4547020b34-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0a848c68-7b11-4e42-856c-f500c457066a tempest-VolumeDependencyTests-1832216537 None] Lock "cinder-7b7b8359-0eed-439c-b19b-5c4547020b34-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0a848c68-7b11-4e42-856c-f500c457066a tempest-VolumeDependencyTests-1832216537 None] Acquiring lock "cinder-quobyte-7b7b8359-0eed-439c-b19b-5c4547020b34" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0a848c68-7b11-4e42-856c-f500c457066a tempest-VolumeDependencyTests-1832216537 None] Lock "cinder-quobyte-7b7b8359-0eed-439c-b19b-5c4547020b34" acquired by "delete_volume" :: waited 0.030s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec973c13-abc3-4505-a33c-e648e167436e]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0a848c68-7b11-4e42-856c-f500c457066a tempest-VolumeDependencyTests-1832216537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b7b8359-0eed-439c-b19b-5c4547020b34 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:12 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-aafaba68-7d11-4448-812d-2c0d2ec70ccf tempest-VolumeDependencyTests-1832216537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.476s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-aafaba68-7d11-4448-812d-2c0d2ec70ccf tempest-VolumeDependencyTests-1832216537 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:21:12 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-aafaba68-7d11-4448-812d-2c0d2ec70ccf tempest-VolumeDependencyTests-1832216537 None] Deleted volume successfully. Sep 05 05:21:12 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:12 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b7b8359-0eed-439c-b19b-5c4547020b34 Sep 05 05:21:12 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f6ebb313-089e-4902-bb1b-3f20aa3a644f tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.823bcd59-45d0-4b37-a9fb-5ab7adea6b75" returned: 0 in 0.608s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f6ebb313-089e-4902-bb1b-3f20aa3a644f tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.823bcd59-45d0-4b37-a9fb-5ab7adea6b75 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-aafaba68-7d11-4448-812d-2c0d2ec70ccf tempest-VolumeDependencyTests-1832216537 None] Lock "cinder-ee688d11-2cc3-4da9-9369-025bb08b458c-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:12 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.823bcd59-45d0-4b37-a9fb-5ab7adea6b75 Sep 05 05:21:12 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-cbda1de2-4f5e-4336-b05d-fb4c0a290e5a tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-cbda1de2-4f5e-4336-b05d-fb4c0a290e5a tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-cbda1de2-4f5e-4336-b05d-fb4c0a290e5a tempest-ProjectMemberTests-1299516133 None] Creating offline snapshot 6cba5a49-6541-4d8d-beb5-3523501d658c of volume 74b128dd-e286-4e16-a512-8ea20f46cb86 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f96233-000c-45e4-95fb-6dd8fe5d2f83]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-cbda1de2-4f5e-4336-b05d-fb4c0a290e5a tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:13 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86 Sep 05 05:21:13 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:13 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0a848c68-7b11-4e42-856c-f500c457066a tempest-VolumeDependencyTests-1832216537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b7b8359-0eed-439c-b19b-5c4547020b34" returned: 0 in 0.695s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0a848c68-7b11-4e42-856c-f500c457066a tempest-VolumeDependencyTests-1832216537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b7b8359-0eed-439c-b19b-5c4547020b34 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:13 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:13 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b7b8359-0eed-439c-b19b-5c4547020b34 Sep 05 05:21:13 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f6ebb313-089e-4902-bb1b-3f20aa3a644f tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782.823bcd59-45d0-4b37-a9fb-5ab7adea6b75" returned: 0 in 0.443s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:13 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f6ebb313-089e-4902-bb1b-3f20aa3a644f tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-823bcd59-45d0-4b37-a9fb-5ab7adea6b75" released by "_delete_snapshot" :: held 2.089s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:13 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f6ebb313-089e-4902-bb1b-3f20aa3a644f tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-881a3a00-e782-4d1c-8a7d-6bbebd14b782" released by "delete_snapshot" :: held 2.137s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:13 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-f6ebb313-089e-4902-bb1b-3f20aa3a644f tempest-ProjectReaderTests-544844019 None] Created reservations ['6e92ae30-b9fc-437c-aa44-0f02513411a6', '4f65ab04-8276-4c33-a236-e6608e734c72', 'de1298ff-d189-433c-bebf-513989726b56', '2e676189-4ce9-40ae-8514-8ae1c5149096'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:13 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-f6ebb313-089e-4902-bb1b-3f20aa3a644f tempest-ProjectReaderTests-544844019 None] Delete snapshot completed successfully. Sep 05 05:21:13 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f6ebb313-089e-4902-bb1b-3f20aa3a644f tempest-ProjectReaderTests-544844019 None] Lock "cinder-823bcd59-45d0-4b37-a9fb-5ab7adea6b75-delete_snapshot" released by "delete_snapshot" :: held 2.400s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:13 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0a848c68-7b11-4e42-856c-f500c457066a tempest-VolumeDependencyTests-1832216537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7b7b8359-0eed-439c-b19b-5c4547020b34" returned: 0 in 0.375s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:13 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-cbda1de2-4f5e-4336-b05d-fb4c0a290e5a tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86" returned: 0 in 0.550s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-cbda1de2-4f5e-4336-b05d-fb4c0a290e5a tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.6cba5a49-6541-4d8d-beb5-3523501d658c 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:13 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0a848c68-7b11-4e42-856c-f500c457066a tempest-VolumeDependencyTests-1832216537 None] Lock "cinder-quobyte-7b7b8359-0eed-439c-b19b-5c4547020b34" released by "delete_volume" :: held 1.134s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:13 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.6cba5a49-6541-4d8d-beb5-3523501d658c 1G Sep 05 05:21:13 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:13 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-0a848c68-7b11-4e42-856c-f500c457066a tempest-VolumeDependencyTests-1832216537 None] Created reservations ['a41928a0-1232-4f9d-bb92-e7682a095918', 'f7153dbf-3627-4e74-88b7-6ff704648704', '7bce4a01-fef2-4f4d-a7d1-4bdd45055a74', '14b5fe85-645f-448f-96a0-575cea7de0e1'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0a848c68-7b11-4e42-856c-f500c457066a tempest-VolumeDependencyTests-1832216537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0a848c68-7b11-4e42-856c-f500c457066a tempest-VolumeDependencyTests-1832216537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:13 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0a848c68-7b11-4e42-856c-f500c457066a tempest-VolumeDependencyTests-1832216537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:13 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0a848c68-7b11-4e42-856c-f500c457066a tempest-VolumeDependencyTests-1832216537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0a848c68-7b11-4e42-856c-f500c457066a tempest-VolumeDependencyTests-1832216537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0a848c68-7b11-4e42-856c-f500c457066a tempest-VolumeDependencyTests-1832216537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:13 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:21:13 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:13 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:13 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0a848c68-7b11-4e42-856c-f500c457066a tempest-VolumeDependencyTests-1832216537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.266s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:13 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-0a848c68-7b11-4e42-856c-f500c457066a tempest-VolumeDependencyTests-1832216537 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:21:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-cbda1de2-4f5e-4336-b05d-fb4c0a290e5a tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.6cba5a49-6541-4d8d-beb5-3523501d658c 1G" returned: 0 in 0.471s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-cbda1de2-4f5e-4336-b05d-fb4c0a290e5a tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74b128dd-e286-4e16-a512-8ea20f46cb86 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.6cba5a49-6541-4d8d-beb5-3523501d658c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:13 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-0a848c68-7b11-4e42-856c-f500c457066a tempest-VolumeDependencyTests-1832216537 None] Deleted volume successfully. Sep 05 05:21:13 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74b128dd-e286-4e16-a512-8ea20f46cb86 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.6cba5a49-6541-4d8d-beb5-3523501d658c Sep 05 05:21:13 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:13 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0a848c68-7b11-4e42-856c-f500c457066a tempest-VolumeDependencyTests-1832216537 None] Lock "cinder-7b7b8359-0eed-439c-b19b-5c4547020b34-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:14 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-68a4cfa1-3a6f-444a-84ff-adfc33db77b7 tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-881a3a00-e782-4d1c-8a7d-6bbebd14b782-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:14 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-cbda1de2-4f5e-4336-b05d-fb4c0a290e5a tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74b128dd-e286-4e16-a512-8ea20f46cb86 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.6cba5a49-6541-4d8d-beb5-3523501d658c" returned: 0 in 0.320s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:14 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-cbda1de2-4f5e-4336-b05d-fb4c0a290e5a tempest-ProjectMemberTests-1299516133 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.6cba5a49-6541-4d8d-beb5-3523501d658c is being set with open permissions: ugo+rw Sep 05 05:21:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-cbda1de2-4f5e-4336-b05d-fb4c0a290e5a tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.6cba5a49-6541-4d8d-beb5-3523501d658c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:14 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-68a4cfa1-3a6f-444a-84ff-adfc33db77b7 tempest-ProjectReaderTests-544844019 None] Lock "cinder-881a3a00-e782-4d1c-8a7d-6bbebd14b782-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:14 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.6cba5a49-6541-4d8d-beb5-3523501d658c Sep 05 05:21:14 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:14 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-68a4cfa1-3a6f-444a-84ff-adfc33db77b7 tempest-ProjectReaderTests-544844019 None] Acquiring lock "cinder-quobyte-881a3a00-e782-4d1c-8a7d-6bbebd14b782" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:14 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-68a4cfa1-3a6f-444a-84ff-adfc33db77b7 tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-881a3a00-e782-4d1c-8a7d-6bbebd14b782" acquired by "delete_volume" :: waited 0.023s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:14 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3d0fcf-78d6-4605-93f6-1cb1de732920]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-68a4cfa1-3a6f-444a-84ff-adfc33db77b7 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:14 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782 Sep 05 05:21:14 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:14 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-cbda1de2-4f5e-4336-b05d-fb4c0a290e5a tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.6cba5a49-6541-4d8d-beb5-3523501d658c" returned: 0 in 0.310s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-cbda1de2-4f5e-4336-b05d-fb4c0a290e5a tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:14 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.info Sep 05 05:21:14 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:14 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-68a4cfa1-3a6f-444a-84ff-adfc33db77b7 tempest-ProjectReaderTests-544844019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782" returned: 0 in 0.511s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-68a4cfa1-3a6f-444a-84ff-adfc33db77b7 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:14 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782 Sep 05 05:21:14 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:14 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-cbda1de2-4f5e-4336-b05d-fb4c0a290e5a tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.info" returned: 0 in 0.368s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:14 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-cbda1de2-4f5e-4336-b05d-fb4c0a290e5a tempest-ProjectMemberTests-1299516133 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.info is being set with open permissions: ugo+rw Sep 05 05:21:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-cbda1de2-4f5e-4336-b05d-fb4c0a290e5a tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:15 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.info Sep 05 05:21:15 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:15 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-68a4cfa1-3a6f-444a-84ff-adfc33db77b7 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-881a3a00-e782-4d1c-8a7d-6bbebd14b782" returned: 0 in 0.298s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-68a4cfa1-3a6f-444a-84ff-adfc33db77b7 tempest-ProjectReaderTests-544844019 None] Lock "cinder-quobyte-881a3a00-e782-4d1c-8a7d-6bbebd14b782" released by "delete_volume" :: held 0.881s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:15 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-68a4cfa1-3a6f-444a-84ff-adfc33db77b7 tempest-ProjectReaderTests-544844019 None] Created reservations ['45915f19-1ac5-4ec3-9f9a-6de5efa3c47c', '8ed21142-3299-4734-b063-b3bcdf7c6bed', '04793c86-78cf-4a59-846c-cf61463d03c0', '5c273ed9-d45c-4380-9b1d-cb458524d5a7'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:15 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-cbda1de2-4f5e-4336-b05d-fb4c0a290e5a tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.info" returned: 0 in 0.382s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-cbda1de2-4f5e-4336-b05d-fb4c0a290e5a tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.526s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:15 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-cbda1de2-4f5e-4336-b05d-fb4c0a290e5a tempest-ProjectMemberTests-1299516133 None] Create snapshot completed successfully Sep 05 05:21:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-68a4cfa1-3a6f-444a-84ff-adfc33db77b7 tempest-ProjectReaderTests-544844019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-68a4cfa1-3a6f-444a-84ff-adfc33db77b7 tempest-ProjectReaderTests-544844019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:15 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-68a4cfa1-3a6f-444a-84ff-adfc33db77b7 tempest-ProjectReaderTests-544844019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:15 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-68a4cfa1-3a6f-444a-84ff-adfc33db77b7 tempest-ProjectReaderTests-544844019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-68a4cfa1-3a6f-444a-84ff-adfc33db77b7 tempest-ProjectReaderTests-544844019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-68a4cfa1-3a6f-444a-84ff-adfc33db77b7 tempest-ProjectReaderTests-544844019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:15 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:21:15 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:15 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-68a4cfa1-3a6f-444a-84ff-adfc33db77b7 tempest-ProjectReaderTests-544844019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.300s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:15 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-68a4cfa1-3a6f-444a-84ff-adfc33db77b7 tempest-ProjectReaderTests-544844019 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:21:15 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-68a4cfa1-3a6f-444a-84ff-adfc33db77b7 tempest-ProjectReaderTests-544844019 None] Deleted volume successfully. Sep 05 05:21:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-68a4cfa1-3a6f-444a-84ff-adfc33db77b7 tempest-ProjectReaderTests-544844019 None] Lock "cinder-881a3a00-e782-4d1c-8a7d-6bbebd14b782-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fb7ccefb-c819-418d-94ca-9ef75be2a3d7 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-6cba5a49-6541-4d8d-beb5-3523501d658c-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fb7ccefb-c819-418d-94ca-9ef75be2a3d7 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-6cba5a49-6541-4d8d-beb5-3523501d658c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fb7ccefb-c819-418d-94ca-9ef75be2a3d7 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-74b128dd-e286-4e16-a512-8ea20f46cb86" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fb7ccefb-c819-418d-94ca-9ef75be2a3d7 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-74b128dd-e286-4e16-a512-8ea20f46cb86" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fb7ccefb-c819-418d-94ca-9ef75be2a3d7 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-6cba5a49-6541-4d8d-beb5-3523501d658c" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fb7ccefb-c819-418d-94ca-9ef75be2a3d7 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-6cba5a49-6541-4d8d-beb5-3523501d658c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:16 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-fb7ccefb-c819-418d-94ca-9ef75be2a3d7 tempest-ProjectMemberTests-1299516133 None] Deleting offline snapshot 6cba5a49-6541-4d8d-beb5-3523501d658c of volume 74b128dd-e286-4e16-a512-8ea20f46cb86 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:21:16 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-fb7ccefb-c819-418d-94ca-9ef75be2a3d7 tempest-ProjectMemberTests-1299516133 None] snapshot_file for this snap is: volume-74b128dd-e286-4e16-a512-8ea20f46cb86.6cba5a49-6541-4d8d-beb5-3523501d658c {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:21:16 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[098f64a0-5eeb-4539-86aa-1399fa6dbfaa]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fb7ccefb-c819-418d-94ca-9ef75be2a3d7 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.6cba5a49-6541-4d8d-beb5-3523501d658c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:16 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.6cba5a49-6541-4d8d-beb5-3523501d658c Sep 05 05:21:16 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:16 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fb7ccefb-c819-418d-94ca-9ef75be2a3d7 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.6cba5a49-6541-4d8d-beb5-3523501d658c" returned: 0 in 0.491s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:16 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-fb7ccefb-c819-418d-94ca-9ef75be2a3d7 tempest-ProjectMemberTests-1299516133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74b128dd-e286-4e16-a512-8ea20f46cb86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:21:16 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d238ed-30f8-41f2-b49a-4d7907eb6873]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fb7ccefb-c819-418d-94ca-9ef75be2a3d7 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:16 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86 Sep 05 05:21:16 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:17 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fb7ccefb-c819-418d-94ca-9ef75be2a3d7 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86" returned: 0 in 0.440s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fb7ccefb-c819-418d-94ca-9ef75be2a3d7 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.6cba5a49-6541-4d8d-beb5-3523501d658c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:17 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.6cba5a49-6541-4d8d-beb5-3523501d658c Sep 05 05:21:17 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:17 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fb7ccefb-c819-418d-94ca-9ef75be2a3d7 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.6cba5a49-6541-4d8d-beb5-3523501d658c" returned: 0 in 0.447s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fb7ccefb-c819-418d-94ca-9ef75be2a3d7 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.6cba5a49-6541-4d8d-beb5-3523501d658c {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:17 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.6cba5a49-6541-4d8d-beb5-3523501d658c Sep 05 05:21:17 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:18 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fb7ccefb-c819-418d-94ca-9ef75be2a3d7 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86.6cba5a49-6541-4d8d-beb5-3523501d658c" returned: 0 in 0.415s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fb7ccefb-c819-418d-94ca-9ef75be2a3d7 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-6cba5a49-6541-4d8d-beb5-3523501d658c" released by "_delete_snapshot" :: held 1.967s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fb7ccefb-c819-418d-94ca-9ef75be2a3d7 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-74b128dd-e286-4e16-a512-8ea20f46cb86" released by "delete_snapshot" :: held 1.993s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:18 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-fb7ccefb-c819-418d-94ca-9ef75be2a3d7 tempest-ProjectMemberTests-1299516133 None] Created reservations ['2f6d8b35-fb23-480c-acb5-f244d4ff6bbb', 'f34486cb-4b03-44fd-848f-48bc9815e59e', '1acc3374-afa6-4bc2-9fea-f9888a14a243', '7f8c8bf4-412c-4777-a5f2-c0663ab1d8f7'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:18 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-fb7ccefb-c819-418d-94ca-9ef75be2a3d7 tempest-ProjectMemberTests-1299516133 None] Delete snapshot completed successfully. Sep 05 05:21:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fb7ccefb-c819-418d-94ca-9ef75be2a3d7 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-6cba5a49-6541-4d8d-beb5-3523501d658c-delete_snapshot" released by "delete_snapshot" :: held 2.199s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:19 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d8c41fc1-818c-41e3-b037-46cbe1610f88 tempest-ProjectAdminTests-1959903860 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6874046325684, 'free_capacity_gb': 1773.6874046325684, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89331) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 05 05:21:19 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-744935eb-a1c8-47fe-9734-c3dee957d3c4 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-74b128dd-e286-4e16-a512-8ea20f46cb86-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:19 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-744935eb-a1c8-47fe-9734-c3dee957d3c4 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-74b128dd-e286-4e16-a512-8ea20f46cb86-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:19 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-744935eb-a1c8-47fe-9734-c3dee957d3c4 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-74b128dd-e286-4e16-a512-8ea20f46cb86" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:19 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-744935eb-a1c8-47fe-9734-c3dee957d3c4 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-74b128dd-e286-4e16-a512-8ea20f46cb86" acquired by "delete_volume" :: waited 0.059s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:19 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8b2466-cfd0-4c13-8f2d-b2b289f9d00c]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:19 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-744935eb-a1c8-47fe-9734-c3dee957d3c4 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:19 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86 Sep 05 05:21:19 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:20 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-744935eb-a1c8-47fe-9734-c3dee957d3c4 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86" returned: 0 in 0.532s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-744935eb-a1c8-47fe-9734-c3dee957d3c4 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:20 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86 Sep 05 05:21:20 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:20 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-744935eb-a1c8-47fe-9734-c3dee957d3c4 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-74b128dd-e286-4e16-a512-8ea20f46cb86" returned: 0 in 0.373s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:20 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-744935eb-a1c8-47fe-9734-c3dee957d3c4 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-74b128dd-e286-4e16-a512-8ea20f46cb86" released by "delete_volume" :: held 1.080s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:20 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-744935eb-a1c8-47fe-9734-c3dee957d3c4 tempest-ProjectMemberTests-1299516133 None] Created reservations ['03c2244e-c62a-4b8a-afc4-0ce6fb9236eb', 'b2fd4a2a-7174-4aa8-91f6-e2bb7e04a637', '27c437a5-8ed3-4413-b401-6ce0fd4c2cc0', '5a1b93fc-2f57-4b85-b4e3-21f5a31dd9b0'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-744935eb-a1c8-47fe-9734-c3dee957d3c4 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-744935eb-a1c8-47fe-9734-c3dee957d3c4 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-744935eb-a1c8-47fe-9734-c3dee957d3c4 tempest-ProjectMemberTests-1299516133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:20 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-744935eb-a1c8-47fe-9734-c3dee957d3c4 tempest-ProjectMemberTests-1299516133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-744935eb-a1c8-47fe-9734-c3dee957d3c4 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:20 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-744935eb-a1c8-47fe-9734-c3dee957d3c4 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:20 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:21:20 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:21 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:21 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-744935eb-a1c8-47fe-9734-c3dee957d3c4 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.352s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:21 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-744935eb-a1c8-47fe-9734-c3dee957d3c4 tempest-ProjectMemberTests-1299516133 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:21:21 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-744935eb-a1c8-47fe-9734-c3dee957d3c4 tempest-ProjectMemberTests-1299516133 None] Deleted volume successfully. Sep 05 05:21:21 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-744935eb-a1c8-47fe-9734-c3dee957d3c4 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-74b128dd-e286-4e16-a512-8ea20f46cb86-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Flow 'volume_create_manager' (e6200e09-86e1-4207-bd42-ae928dfe143e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff5774d-4606-4751-93d9-66673a03900a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff5774d-4606-4751-93d9-66673a03900a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1397524375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d59726a5-274f-4f9d-aa54-8a530b6c983d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b10a8e34d5194ceb8a6ace6bd1d2b548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:22Z,use_quota=True,user_id='0852ea3c4af6414291c40126a95cf23a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92915caf-50f2-46af-a194-68ea8f38f8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92915caf-50f2-46af-a194-68ea8f38f8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df7b605-a4bf-4de2-b0a1-4087076bf941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df7b605-a4bf-4de2-b0a1-4087076bf941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd59726a5-274f-4f9d-aa54-8a530b6c983d', 'volume_name': 'volume-d59726a5-274f-4f9d-aa54-8a530b6c983d', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729d9b33-2971-4311-878a-f3b4bd6a3680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729d9b33-2971-4311-878a-f3b4bd6a3680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46a047c-a060-466f-b318-a6b690571507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:22 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Volume d59726a5-274f-4f9d-aa54-8a530b6c983d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d59726a5-274f-4f9d-aa54-8a530b6c983d', 'volume_size': 1} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1397524375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d59726a5-274f-4f9d-aa54-8a530b6c983d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b10a8e34d5194ceb8a6ace6bd1d2b548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:22Z,use_quota=True,user_id='0852ea3c4af6414291c40126a95cf23a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Creating volume d59726a5-274f-4f9d-aa54-8a530b6c983d {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:21:22 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d59726a5-274f-4f9d-aa54-8a530b6c983d 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:22 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d59726a5-274f-4f9d-aa54-8a530b6c983d 1073741824 Sep 05 05:21:22 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Flow 'volume_create_manager' (2b08406c-64fd-4037-bfe8-f004c67f88d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99854e8e-99e4-4b37-95dc-b46378da6f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99854e8e-99e4-4b37-95dc-b46378da6f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1541773308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6d32a1-c6fc-406d-a9db-7868e90565e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad580cb1010b4899b3d6f4071f9a30c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:23Z,use_quota=True,user_id='777649d126094987b71ca3b21cd760a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88852ae6-9c24-44fa-8a9a-21803d7d3db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88852ae6-9c24-44fa-8a9a-21803d7d3db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa009f70-71ff-428d-a690-a24471dcfb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa009f70-71ff-428d-a690-a24471dcfb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf6d32a1-c6fc-406d-a9db-7868e90565e0', 'volume_name': 'volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c021fff4-4d0e-4b20-bf3f-23b99c80bd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c021fff4-4d0e-4b20-bf3f-23b99c80bd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f1651d-4cd9-4c76-a9fa-1c4d5b675b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:22 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Volume cf6d32a1-c6fc-406d-a9db-7868e90565e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0', 'volume_size': 1} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:22 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d59726a5-274f-4f9d-aa54-8a530b6c983d 1073741824" returned: 0 in 0.789s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:22 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d59726a5-274f-4f9d-aa54-8a530b6c983d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:23 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d59726a5-274f-4f9d-aa54-8a530b6c983d Sep 05 05:21:23 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:23 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d59726a5-274f-4f9d-aa54-8a530b6c983d" returned: 0 in 0.310s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:21:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.503s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1541773308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6d32a1-c6fc-406d-a9db-7868e90565e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad580cb1010b4899b3d6f4071f9a30c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:23Z,use_quota=True,user_id='777649d126094987b71ca3b21cd760a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:21:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Creating volume cf6d32a1-c6fc-406d-a9db-7868e90565e0 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:21:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:23 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:21:23 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:21:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46a047c-a060-466f-b318-a6b690571507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d59726a5-274f-4f9d-aa54-8a530b6c983d', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:23 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0 1073741824 Sep 05 05:21:23 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9933ccd-83b5-47b7-b1b5-d9328e1460f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:23 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Volume volume-d59726a5-274f-4f9d-aa54-8a530b6c983d (d59726a5-274f-4f9d-aa54-8a530b6c983d): created successfully Sep 05 05:21:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9933ccd-83b5-47b7-b1b5-d9328e1460f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:23 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Flow 'volume_create_manager' (e6200e09-86e1-4207-bd42-ae928dfe143e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:23 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ba66c363-dae6-49dc-b02a-d665f3df246c tempest-ProjectReaderTests-509845015 None] Created volume successfully. Sep 05 05:21:23 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0 1073741824" returned: 0 in 0.533s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:23 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:23 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0 Sep 05 05:21:23 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:24 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0" returned: 0 in 0.341s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:24 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:21:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f1651d-4cd9-4c76-a9fa-1c4d5b675b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d288520c-b06f-4e2a-88d0-ba42eb9ab8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:24 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Volume volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0 (cf6d32a1-c6fc-406d-a9db-7868e90565e0): created successfully Sep 05 05:21:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d288520c-b06f-4e2a-88d0-ba42eb9ab8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:24 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Flow 'volume_create_manager' (2b08406c-64fd-4037-bfe8-f004c67f88d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:24 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-95fa4ab2-9905-42ee-8423-9745c8614895 tempest-ProjectMemberTests-1299516133 None] Created volume successfully. Sep 05 05:21:24 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0e08c8a9-bf4b-456b-93f6-8e1f248d3b52 tempest-ProjectReaderTests-509845015 None] Acquiring lock "cinder-d59726a5-274f-4f9d-aa54-8a530b6c983d-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:24 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0e08c8a9-bf4b-456b-93f6-8e1f248d3b52 tempest-ProjectReaderTests-509845015 None] Lock "cinder-d59726a5-274f-4f9d-aa54-8a530b6c983d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:24 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0e08c8a9-bf4b-456b-93f6-8e1f248d3b52 tempest-ProjectReaderTests-509845015 None] Acquiring lock "cinder-quobyte-d59726a5-274f-4f9d-aa54-8a530b6c983d" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:24 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0e08c8a9-bf4b-456b-93f6-8e1f248d3b52 tempest-ProjectReaderTests-509845015 None] Lock "cinder-quobyte-d59726a5-274f-4f9d-aa54-8a530b6c983d" acquired by "delete_volume" :: waited 0.024s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:24 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96b7bbc-1b98-4949-ac92-e19910713a6f]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:24 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0e08c8a9-bf4b-456b-93f6-8e1f248d3b52 tempest-ProjectReaderTests-509845015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d59726a5-274f-4f9d-aa54-8a530b6c983d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:24 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d59726a5-274f-4f9d-aa54-8a530b6c983d Sep 05 05:21:24 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:25 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0e08c8a9-bf4b-456b-93f6-8e1f248d3b52 tempest-ProjectReaderTests-509845015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d59726a5-274f-4f9d-aa54-8a530b6c983d" returned: 0 in 0.449s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0e08c8a9-bf4b-456b-93f6-8e1f248d3b52 tempest-ProjectReaderTests-509845015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d59726a5-274f-4f9d-aa54-8a530b6c983d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:25 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d59726a5-274f-4f9d-aa54-8a530b6c983d Sep 05 05:21:25 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-395febc1-b805-4d02-8b8c-b78ff211eae1 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-395febc1-b805-4d02-8b8c-b78ff211eae1 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-395febc1-b805-4d02-8b8c-b78ff211eae1 tempest-ProjectMemberTests-1299516133 None] Creating offline snapshot b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe of volume cf6d32a1-c6fc-406d-a9db-7868e90565e0 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2916066e-c9bf-4339-be2d-d95e7db3fecb]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-395febc1-b805-4d02-8b8c-b78ff211eae1 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:25 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0e08c8a9-bf4b-456b-93f6-8e1f248d3b52 tempest-ProjectReaderTests-509845015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-d59726a5-274f-4f9d-aa54-8a530b6c983d" returned: 0 in 0.308s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0e08c8a9-bf4b-456b-93f6-8e1f248d3b52 tempest-ProjectReaderTests-509845015 None] Lock "cinder-quobyte-d59726a5-274f-4f9d-aa54-8a530b6c983d" released by "delete_volume" :: held 0.852s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-0e08c8a9-bf4b-456b-93f6-8e1f248d3b52 tempest-ProjectReaderTests-509845015 None] Created reservations ['f4b14215-e5ec-4a74-a70f-7d2598552216', '8c5363db-f05c-44a4-a627-17d570f4e2f9', 'a8c7cf03-d1f7-4523-b992-7e64c6e94f73', '853f32fc-1d7f-4438-a896-491e0e97a661'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:25 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0 Sep 05 05:21:25 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0e08c8a9-bf4b-456b-93f6-8e1f248d3b52 tempest-ProjectReaderTests-509845015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0e08c8a9-bf4b-456b-93f6-8e1f248d3b52 tempest-ProjectReaderTests-509845015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0e08c8a9-bf4b-456b-93f6-8e1f248d3b52 tempest-ProjectReaderTests-509845015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-0e08c8a9-bf4b-456b-93f6-8e1f248d3b52 tempest-ProjectReaderTests-509845015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0e08c8a9-bf4b-456b-93f6-8e1f248d3b52 tempest-ProjectReaderTests-509845015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0e08c8a9-bf4b-456b-93f6-8e1f248d3b52 tempest-ProjectReaderTests-509845015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:25 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:21:25 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Flow 'volume_create_manager' (e874b169-f9e2-46e3-83e4-708f7b8b1eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4a308a9-aa42-4719-8514-9f6293eb5fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4a308a9-aa42-4719-8514-9f6293eb5fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-652367298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=113f5443-669e-4dcf-8a91-e24d436b515d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee824648778349088a944112368e4b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:26Z,use_quota=True,user_id='497309e0028049e5923e51c7064d34ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d055cc-339c-49c5-9404-f10b9e65fcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d055cc-339c-49c5-9404-f10b9e65fcfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d7dafb-2c6c-45eb-a1c2-2ed65ec74faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d7dafb-2c6c-45eb-a1c2-2ed65ec74faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '113f5443-669e-4dcf-8a91-e24d436b515d', 'volume_name': 'volume-113f5443-669e-4dcf-8a91-e24d436b515d', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68362ace-999c-412f-a342-83c475a1deab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68362ace-999c-412f-a342-83c475a1deab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e8f76d-4c78-4f54-a6be-776c07868c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:25 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Volume 113f5443-669e-4dcf-8a91-e24d436b515d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-113f5443-669e-4dcf-8a91-e24d436b515d', 'volume_size': 1} Sep 05 05:21:25 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:26 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-395febc1-b805-4d02-8b8c-b78ff211eae1 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0" returned: 0 in 0.670s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-395febc1-b805-4d02-8b8c-b78ff211eae1 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:26 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0e08c8a9-bf4b-456b-93f6-8e1f248d3b52 tempest-ProjectReaderTests-509845015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.450s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:26 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-0e08c8a9-bf4b-456b-93f6-8e1f248d3b52 tempest-ProjectReaderTests-509845015 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:21:26 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-0e08c8a9-bf4b-456b-93f6-8e1f248d3b52 tempest-ProjectReaderTests-509845015 None] Deleted volume successfully. Sep 05 05:21:26 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe 1G Sep 05 05:21:26 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:26 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-0e08c8a9-bf4b-456b-93f6-8e1f248d3b52 tempest-ProjectReaderTests-509845015 None] Lock "cinder-d59726a5-274f-4f9d-aa54-8a530b6c983d-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:26 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:21:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Flow 'volume_create_manager' (e91688d3-9569-42f2-bfa8-f74c57e8b509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3028c696-2f81-494d-b266-d08f24cb7310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3028c696-2f81-494d-b266-d08f24cb7310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-803053888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d5c8836-75f1-4e90-b56f-2dfba3a632e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b10a8e34d5194ceb8a6ace6bd1d2b548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:26Z,use_quota=True,user_id='0852ea3c4af6414291c40126a95cf23a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca6992ae-880e-4372-a3da-5139bf28aafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca6992ae-880e-4372-a3da-5139bf28aafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f92c5cda-0db9-4e38-ae51-bce6e398f821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f92c5cda-0db9-4e38-ae51-bce6e398f821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d5c8836-75f1-4e90-b56f-2dfba3a632e5', 'volume_name': 'volume-7d5c8836-75f1-4e90-b56f-2dfba3a632e5', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0e547e-4974-4faa-9bc4-bebfc6154d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0e547e-4974-4faa-9bc4-bebfc6154d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:26 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd77072-8094-433b-b1f2-e2701e3f43c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:26 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Volume 7d5c8836-75f1-4e90-b56f-2dfba3a632e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d5c8836-75f1-4e90-b56f-2dfba3a632e5', 'volume_size': 1} Sep 05 05:21:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:26 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-395febc1-b805-4d02-8b8c-b78ff211eae1 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe 1G" returned: 0 in 0.429s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-395febc1-b805-4d02-8b8c-b78ff211eae1 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:26 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe Sep 05 05:21:26 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:26 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-395febc1-b805-4d02-8b8c-b78ff211eae1 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe" returned: 0 in 0.292s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:26 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-395febc1-b805-4d02-8b8c-b78ff211eae1 tempest-ProjectMemberTests-1299516133 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe is being set with open permissions: ugo+rw Sep 05 05:21:26 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-395febc1-b805-4d02-8b8c-b78ff211eae1 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:26 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe Sep 05 05:21:26 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:26 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-395febc1-b805-4d02-8b8c-b78ff211eae1 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe" returned: 0 in 0.248s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-395febc1-b805-4d02-8b8c-b78ff211eae1 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:27 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.info Sep 05 05:21:27 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:27 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-395febc1-b805-4d02-8b8c-b78ff211eae1 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.info" returned: 0 in 0.254s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:27 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-395febc1-b805-4d02-8b8c-b78ff211eae1 tempest-ProjectMemberTests-1299516133 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.info is being set with open permissions: ugo+rw Sep 05 05:21:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-395febc1-b805-4d02-8b8c-b78ff211eae1 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:27 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.info Sep 05 05:21:27 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:27 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-395febc1-b805-4d02-8b8c-b78ff211eae1 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.info" returned: 0 in 0.259s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-395febc1-b805-4d02-8b8c-b78ff211eae1 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.252s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.634s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-652367298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=113f5443-669e-4dcf-8a91-e24d436b515d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee824648778349088a944112368e4b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:26Z,use_quota=True,user_id='497309e0028049e5923e51c7064d34ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:21:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Creating volume 113f5443-669e-4dcf-8a91-e24d436b515d {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:21:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:27 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:21:27 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:21:27 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:27 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d 1073741824 Sep 05 05:21:27 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:27 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-395febc1-b805-4d02-8b8c-b78ff211eae1 tempest-ProjectMemberTests-1299516133 None] Create snapshot completed successfully Sep 05 05:21:28 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d 1073741824" returned: 0 in 0.436s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:28 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d Sep 05 05:21:28 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:28 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d" returned: 0 in 0.245s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.943s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-803053888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d5c8836-75f1-4e90-b56f-2dfba3a632e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b10a8e34d5194ceb8a6ace6bd1d2b548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:26Z,use_quota=True,user_id='0852ea3c4af6414291c40126a95cf23a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Creating volume 7d5c8836-75f1-4e90-b56f-2dfba3a632e5 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:21:28 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7d5c8836-75f1-4e90-b56f-2dfba3a632e5 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e8f76d-4c78-4f54-a6be-776c07868c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-113f5443-669e-4dcf-8a91-e24d436b515d', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:28 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7d5c8836-75f1-4e90-b56f-2dfba3a632e5 1073741824 Sep 05 05:21:28 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854ddb3b-f483-4506-973b-3df005fd176e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:28 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Volume volume-113f5443-669e-4dcf-8a91-e24d436b515d (113f5443-669e-4dcf-8a91-e24d436b515d): created successfully Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854ddb3b-f483-4506-973b-3df005fd176e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Flow 'volume_create_manager' (e874b169-f9e2-46e3-83e4-708f7b8b1eee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:28 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-10707d2c-dbab-4c76-b21e-20cf61dcedcd tempest-SnapshotDependencyTests-2008510584 None] Created volume successfully. Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9a5c3fe1-9136-46ea-b3bf-44a7d4847da0 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9a5c3fe1-9136-46ea-b3bf-44a7d4847da0 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9a5c3fe1-9136-46ea-b3bf-44a7d4847da0 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-cf6d32a1-c6fc-406d-a9db-7868e90565e0" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9a5c3fe1-9136-46ea-b3bf-44a7d4847da0 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-cf6d32a1-c6fc-406d-a9db-7868e90565e0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9a5c3fe1-9136-46ea-b3bf-44a7d4847da0 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9a5c3fe1-9136-46ea-b3bf-44a7d4847da0 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-9a5c3fe1-9136-46ea-b3bf-44a7d4847da0 tempest-ProjectMemberTests-1299516133 None] Deleting offline snapshot b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe of volume cf6d32a1-c6fc-406d-a9db-7868e90565e0 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-9a5c3fe1-9136-46ea-b3bf-44a7d4847da0 tempest-ProjectMemberTests-1299516133 None] snapshot_file for this snap is: volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:21:28 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7d5c8836-75f1-4e90-b56f-2dfba3a632e5 1073741824" returned: 0 in 0.448s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7869af1-4b07-413e-a2d7-6f263cca13ae]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a5c3fe1-9136-46ea-b3bf-44a7d4847da0 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:28 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7d5c8836-75f1-4e90-b56f-2dfba3a632e5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:28 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7d5c8836-75f1-4e90-b56f-2dfba3a632e5 Sep 05 05:21:28 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:28 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe Sep 05 05:21:28 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:29 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7d5c8836-75f1-4e90-b56f-2dfba3a632e5" returned: 0 in 0.333s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0b40c66e-e2df-49ab-823d-b5fe4362ef83 tempest-SnapshotDependencyTests-2008510584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0b40c66e-e2df-49ab-823d-b5fe4362ef83 tempest-SnapshotDependencyTests-2008510584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd77072-8094-433b-b1f2-e2701e3f43c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d5c8836-75f1-4e90-b56f-2dfba3a632e5', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1596869a-755c-4be7-a8b1-fafb8c590457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-0b40c66e-e2df-49ab-823d-b5fe4362ef83 tempest-SnapshotDependencyTests-2008510584 None] Creating offline snapshot 97c90ba8-feb3-4da0-ba0b-041e4bb14640 of volume 113f5443-669e-4dcf-8a91-e24d436b515d {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:21:29 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Volume volume-7d5c8836-75f1-4e90-b56f-2dfba3a632e5 (7d5c8836-75f1-4e90-b56f-2dfba3a632e5): created successfully Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1596869a-755c-4be7-a8b1-fafb8c590457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:29 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Flow 'volume_create_manager' (e91688d3-9569-42f2-bfa8-f74c57e8b509) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2b34d5-c65e-43cd-bc4a-698f606bba59]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0b40c66e-e2df-49ab-823d-b5fe4362ef83 tempest-SnapshotDependencyTests-2008510584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a5c3fe1-9136-46ea-b3bf-44a7d4847da0 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe" returned: 0 in 0.470s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-9a5c3fe1-9136-46ea-b3bf-44a7d4847da0 tempest-ProjectMemberTests-1299516133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:21:29 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-18c8c858-38ff-4d17-9377-56ce4fb0c2de tempest-ProjectReaderTests-509845015 None] Created volume successfully. Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df3a682-9a5c-4bda-89f8-d43fa0ab2492]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a5c3fe1-9136-46ea-b3bf-44a7d4847da0 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:29 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d Sep 05 05:21:29 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:29 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0 Sep 05 05:21:29 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e4a7de9c-3b3a-4116-b928-b6fc18d7119b tempest-ProjectReaderTests-509845015 None] Acquiring lock "cinder-7d5c8836-75f1-4e90-b56f-2dfba3a632e5-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e4a7de9c-3b3a-4116-b928-b6fc18d7119b tempest-ProjectReaderTests-509845015 None] Lock "cinder-7d5c8836-75f1-4e90-b56f-2dfba3a632e5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e4a7de9c-3b3a-4116-b928-b6fc18d7119b tempest-ProjectReaderTests-509845015 None] Acquiring lock "cinder-quobyte-7d5c8836-75f1-4e90-b56f-2dfba3a632e5" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e4a7de9c-3b3a-4116-b928-b6fc18d7119b tempest-ProjectReaderTests-509845015 None] Lock "cinder-quobyte-7d5c8836-75f1-4e90-b56f-2dfba3a632e5" acquired by "delete_volume" :: waited 0.025s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e87e18-aef3-4eba-a112-f33f82271bfc]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e4a7de9c-3b3a-4116-b928-b6fc18d7119b tempest-ProjectReaderTests-509845015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7d5c8836-75f1-4e90-b56f-2dfba3a632e5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:29 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0b40c66e-e2df-49ab-823d-b5fe4362ef83 tempest-SnapshotDependencyTests-2008510584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d" returned: 0 in 0.444s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0b40c66e-e2df-49ab-823d-b5fe4362ef83 tempest-SnapshotDependencyTests-2008510584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.97c90ba8-feb3-4da0-ba0b-041e4bb14640 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:29 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.97c90ba8-feb3-4da0-ba0b-041e4bb14640 1G Sep 05 05:21:29 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:29 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a5c3fe1-9136-46ea-b3bf-44a7d4847da0 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0" returned: 0 in 0.500s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:29 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a5c3fe1-9136-46ea-b3bf-44a7d4847da0 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:29 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7d5c8836-75f1-4e90-b56f-2dfba3a632e5 Sep 05 05:21:29 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:29 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe Sep 05 05:21:29 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:30 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e4a7de9c-3b3a-4116-b928-b6fc18d7119b tempest-ProjectReaderTests-509845015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7d5c8836-75f1-4e90-b56f-2dfba3a632e5" returned: 0 in 0.436s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e4a7de9c-3b3a-4116-b928-b6fc18d7119b tempest-ProjectReaderTests-509845015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7d5c8836-75f1-4e90-b56f-2dfba3a632e5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:30 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7d5c8836-75f1-4e90-b56f-2dfba3a632e5 Sep 05 05:21:30 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:30 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0b40c66e-e2df-49ab-823d-b5fe4362ef83 tempest-SnapshotDependencyTests-2008510584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.97c90ba8-feb3-4da0-ba0b-041e4bb14640 1G" returned: 0 in 0.461s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0b40c66e-e2df-49ab-823d-b5fe4362ef83 tempest-SnapshotDependencyTests-2008510584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-113f5443-669e-4dcf-8a91-e24d436b515d -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.97c90ba8-feb3-4da0-ba0b-041e4bb14640 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:30 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-113f5443-669e-4dcf-8a91-e24d436b515d -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.97c90ba8-feb3-4da0-ba0b-041e4bb14640 Sep 05 05:21:30 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:30 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a5c3fe1-9136-46ea-b3bf-44a7d4847da0 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe" returned: 0 in 0.419s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a5c3fe1-9136-46ea-b3bf-44a7d4847da0 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:30 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe Sep 05 05:21:30 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:30 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e4a7de9c-3b3a-4116-b928-b6fc18d7119b tempest-ProjectReaderTests-509845015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7d5c8836-75f1-4e90-b56f-2dfba3a632e5" returned: 0 in 0.275s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e4a7de9c-3b3a-4116-b928-b6fc18d7119b tempest-ProjectReaderTests-509845015 None] Lock "cinder-quobyte-7d5c8836-75f1-4e90-b56f-2dfba3a632e5" released by "delete_volume" :: held 0.779s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-e4a7de9c-3b3a-4116-b928-b6fc18d7119b tempest-ProjectReaderTests-509845015 None] Created reservations ['20aaf1b5-dfab-4273-9e38-bf244457f6a8', 'df8e018d-9ffc-4d23-bf47-7a9b7316ca37', 'bb69d54a-e073-4ab6-abf7-676adb5ab830', '24364bdc-2408-4783-b414-ae41c9b21e80'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:30 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0b40c66e-e2df-49ab-823d-b5fe4362ef83 tempest-SnapshotDependencyTests-2008510584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-113f5443-669e-4dcf-8a91-e24d436b515d -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.97c90ba8-feb3-4da0-ba0b-041e4bb14640" returned: 0 in 0.372s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:30 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-0b40c66e-e2df-49ab-823d-b5fe4362ef83 tempest-SnapshotDependencyTests-2008510584 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.97c90ba8-feb3-4da0-ba0b-041e4bb14640 is being set with open permissions: ugo+rw Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0b40c66e-e2df-49ab-823d-b5fe4362ef83 tempest-SnapshotDependencyTests-2008510584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.97c90ba8-feb3-4da0-ba0b-041e4bb14640 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:30 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.97c90ba8-feb3-4da0-ba0b-041e4bb14640 Sep 05 05:21:30 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e4a7de9c-3b3a-4116-b928-b6fc18d7119b tempest-ProjectReaderTests-509845015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e4a7de9c-3b3a-4116-b928-b6fc18d7119b tempest-ProjectReaderTests-509845015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e4a7de9c-3b3a-4116-b928-b6fc18d7119b tempest-ProjectReaderTests-509845015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e4a7de9c-3b3a-4116-b928-b6fc18d7119b tempest-ProjectReaderTests-509845015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e4a7de9c-3b3a-4116-b928-b6fc18d7119b tempest-ProjectReaderTests-509845015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:30 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e4a7de9c-3b3a-4116-b928-b6fc18d7119b tempest-ProjectReaderTests-509845015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9a5c3fe1-9136-46ea-b3bf-44a7d4847da0 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0.b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe" returned: 0 in 0.374s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:30 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:21:30 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9a5c3fe1-9136-46ea-b3bf-44a7d4847da0 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe" released by "_delete_snapshot" :: held 1.906s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9a5c3fe1-9136-46ea-b3bf-44a7d4847da0 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-cf6d32a1-c6fc-406d-a9db-7868e90565e0" released by "delete_snapshot" :: held 1.942s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-9a5c3fe1-9136-46ea-b3bf-44a7d4847da0 tempest-ProjectMemberTests-1299516133 None] Created reservations ['46943ca8-a451-44ce-9e84-85ab95015ddc', '530f4138-52a2-464f-a93c-b9fc22c5e41c', 'ecbed4c9-000a-497f-8a7e-e9532e168371', '101e7fed-8d91-4291-a118-6ed28da43e91'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:30 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-9a5c3fe1-9136-46ea-b3bf-44a7d4847da0 tempest-ProjectMemberTests-1299516133 None] Delete snapshot completed successfully. Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9a5c3fe1-9136-46ea-b3bf-44a7d4847da0 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-b1ccbde4-5f7a-4a95-9c24-5c67ce3140fe-delete_snapshot" released by "delete_snapshot" :: held 2.170s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:30 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0b40c66e-e2df-49ab-823d-b5fe4362ef83 tempest-SnapshotDependencyTests-2008510584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.97c90ba8-feb3-4da0-ba0b-041e4bb14640" returned: 0 in 0.390s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0b40c66e-e2df-49ab-823d-b5fe4362ef83 tempest-SnapshotDependencyTests-2008510584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:30 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:30 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.info Sep 05 05:21:30 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e4a7de9c-3b3a-4116-b928-b6fc18d7119b tempest-ProjectReaderTests-509845015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.413s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:30 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-e4a7de9c-3b3a-4116-b928-b6fc18d7119b tempest-ProjectReaderTests-509845015 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:21:30 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-e4a7de9c-3b3a-4116-b928-b6fc18d7119b tempest-ProjectReaderTests-509845015 None] Deleted volume successfully. Sep 05 05:21:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e4a7de9c-3b3a-4116-b928-b6fc18d7119b tempest-ProjectReaderTests-509845015 None] Lock "cinder-7d5c8836-75f1-4e90-b56f-2dfba3a632e5-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:31 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0b40c66e-e2df-49ab-823d-b5fe4362ef83 tempest-SnapshotDependencyTests-2008510584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.info" returned: 0 in 0.318s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:31 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-0b40c66e-e2df-49ab-823d-b5fe4362ef83 tempest-SnapshotDependencyTests-2008510584 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.info is being set with open permissions: ugo+rw Sep 05 05:21:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0b40c66e-e2df-49ab-823d-b5fe4362ef83 tempest-SnapshotDependencyTests-2008510584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:31 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.info Sep 05 05:21:31 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:31 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-0b40c66e-e2df-49ab-823d-b5fe4362ef83 tempest-SnapshotDependencyTests-2008510584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.info" returned: 0 in 0.249s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:31 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-0b40c66e-e2df-49ab-823d-b5fe4362ef83 tempest-SnapshotDependencyTests-2008510584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.352s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:31 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-0b40c66e-e2df-49ab-823d-b5fe4362ef83 tempest-SnapshotDependencyTests-2008510584 None] Create snapshot completed successfully Sep 05 05:21:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e83e498a-d7ab-42e1-9c0f-ec92bf37be45 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-cf6d32a1-c6fc-406d-a9db-7868e90565e0-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e83e498a-d7ab-42e1-9c0f-ec92bf37be45 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-cf6d32a1-c6fc-406d-a9db-7868e90565e0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e83e498a-d7ab-42e1-9c0f-ec92bf37be45 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-cf6d32a1-c6fc-406d-a9db-7868e90565e0" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:31 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e83e498a-d7ab-42e1-9c0f-ec92bf37be45 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-cf6d32a1-c6fc-406d-a9db-7868e90565e0" acquired by "delete_volume" :: waited 0.016s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:32 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca5cd56-df25-42ba-9b67-c731250ee6b6]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e83e498a-d7ab-42e1-9c0f-ec92bf37be45 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:32 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0 Sep 05 05:21:32 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:32 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e83e498a-d7ab-42e1-9c0f-ec92bf37be45 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0" returned: 0 in 0.371s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e83e498a-d7ab-42e1-9c0f-ec92bf37be45 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:32 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0 Sep 05 05:21:32 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:32 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e83e498a-d7ab-42e1-9c0f-ec92bf37be45 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-cf6d32a1-c6fc-406d-a9db-7868e90565e0" returned: 0 in 0.295s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:32 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e83e498a-d7ab-42e1-9c0f-ec92bf37be45 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-cf6d32a1-c6fc-406d-a9db-7868e90565e0" released by "delete_volume" :: held 0.736s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:32 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-e83e498a-d7ab-42e1-9c0f-ec92bf37be45 tempest-ProjectMemberTests-1299516133 None] Created reservations ['00fc839f-bc3c-47b7-8da1-e316ceb21690', '8f8683aa-8ff3-43ba-84f9-b83c8dc8e4a6', 'b0263422-4ecb-401d-9f4e-396514cb9ccd', '345750db-91d6-40ff-9959-93ae3ebdc7c8'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e83e498a-d7ab-42e1-9c0f-ec92bf37be45 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e83e498a-d7ab-42e1-9c0f-ec92bf37be45 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:32 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e83e498a-d7ab-42e1-9c0f-ec92bf37be45 tempest-ProjectMemberTests-1299516133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:32 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-e83e498a-d7ab-42e1-9c0f-ec92bf37be45 tempest-ProjectMemberTests-1299516133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-e83e498a-d7ab-42e1-9c0f-ec92bf37be45 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:32 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e83e498a-d7ab-42e1-9c0f-ec92bf37be45 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:32 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:21:32 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Flow 'volume_create_manager' (d45b1066-1c8f-4751-b489-f45f3e227916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1806c172-c2f8-4723-8a1c-822bb886401d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1806c172-c2f8-4723-8a1c-822bb886401d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f2ec42-6585-47ba-ba9a-8ac01715b162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee824648778349088a944112368e4b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=97c90ba8-feb3-4da0-ba0b-041e4bb14640,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:33Z,use_quota=True,user_id='497309e0028049e5923e51c7064d34ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9baff2ae-0aa3-4b23-8031-767c14dca17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9baff2ae-0aa3-4b23-8031-767c14dca17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a523d46-3106-464f-bd6d-4385ac3999ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a523d46-3106-464f-bd6d-4385ac3999ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c9f2ec42-6585-47ba-ba9a-8ac01715b162', 'volume_name': 'volume-c9f2ec42-6585-47ba-ba9a-8ac01715b162', 'volume_size': 1, 'snapshot_id': '97c90ba8-feb3-4da0-ba0b-041e4bb14640'}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1294c4b-ce91-44ec-9e47-057cc5167f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1294c4b-ce91-44ec-9e47-057cc5167f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:33 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6438c2-e905-47a8-b825-2a47dd613de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:33 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Volume c9f2ec42-6585-47ba-ba9a-8ac01715b162: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c9f2ec42-6585-47ba-ba9a-8ac01715b162', 'volume_size': 1, 'snapshot_id': '97c90ba8-feb3-4da0-ba0b-041e4bb14640'} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e83e498a-d7ab-42e1-9c0f-ec92bf37be45 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.287s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-e83e498a-d7ab-42e1-9c0f-ec92bf37be45 tempest-ProjectMemberTests-1299516133 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:21:33 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-e83e498a-d7ab-42e1-9c0f-ec92bf37be45 tempest-ProjectMemberTests-1299516133 None] Deleted volume successfully. Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Acquiring lock "cinder-quobyte-97c90ba8-feb3-4da0-ba0b-041e4bb14640-c9f2ec42-6585-47ba-ba9a-8ac01715b162" by "_create_volume_from_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e83e498a-d7ab-42e1-9c0f-ec92bf37be45 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-cf6d32a1-c6fc-406d-a9db-7868e90565e0-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Lock "cinder-quobyte-97c90ba8-feb3-4da0-ba0b-041e4bb14640-c9f2ec42-6585-47ba-ba9a-8ac01715b162" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Creating volume c9f2ec42-6585-47ba-ba9a-8ac01715b162 from snapshot 97c90ba8-feb3-4da0-ba0b-041e4bb14640 {{(pid=89331) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Acquiring lock "cinder-quobyte-c9f2ec42-6585-47ba-ba9a-8ac01715b162" by "_copy_volume_from_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Lock "cinder-quobyte-c9f2ec42-6585-47ba-ba9a-8ac01715b162" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] snapshot: 97c90ba8-feb3-4da0-ba0b-041e4bb14640, volume: c9f2ec42-6585-47ba-ba9a-8ac01715b162, {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f537c411-e412-4675-a96c-f461ec26b40c]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.97c90ba8-feb3-4da0-ba0b-041e4bb14640 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:33 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.97c90ba8-feb3-4da0-ba0b-041e4bb14640 Sep 05 05:21:33 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Flow 'volume_create_manager' (e02092c5-c089-4636-98a0-c64b6dc19e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c24b02e-3f56-43a8-9acc-fd6603477357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:33 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c24b02e-3f56-43a8-9acc-fd6603477357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1758592003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec00462f-f975-49b5-a08e-48ddca5b1560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad580cb1010b4899b3d6f4071f9a30c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:34Z,use_quota=True,user_id='777649d126094987b71ca3b21cd760a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fdb69f9-109c-4cc3-953a-5d99f09f37f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fdb69f9-109c-4cc3-953a-5d99f09f37f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b60b493-23c5-4936-9f85-3fdc08b1a22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b60b493-23c5-4936-9f85-3fdc08b1a22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec00462f-f975-49b5-a08e-48ddca5b1560', 'volume_name': 'volume-ec00462f-f975-49b5-a08e-48ddca5b1560', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8751fca4-a9dd-48ea-9313-157c73907c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8751fca4-a9dd-48ea-9313-157c73907c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce70f72f-d37d-4868-a42a-723114273172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:33 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Volume ec00462f-f975-49b5-a08e-48ddca5b1560: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec00462f-f975-49b5-a08e-48ddca5b1560', 'volume_size': 1} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.97c90ba8-feb3-4da0-ba0b-041e4bb14640" returned: 0 in 0.463s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-113f5443-669e-4dcf-8a91-e24d436b515d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7ec2cf-b1e9-4f0d-9e2d-31e95e347012]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:33 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:33 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d Sep 05 05:21:33 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:34 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d" returned: 0 in 0.369s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 05:21:34 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Creating direct copy from snapshot {{(pid=89331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 05:21:34 devstack cinder-volume[89331]: DEBUG cinder.utils [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Path /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c9f2ec42-6585-47ba-ba9a-8ac01715b162 not found in is_blk_device check {{(pid=89331) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 05:21:34 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c9f2ec42-6585-47ba-ba9a-8ac01715b162 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:34 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c9f2ec42-6585-47ba-ba9a-8ac01715b162 Sep 05 05:21:34 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:38 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c9f2ec42-6585-47ba-ba9a-8ac01715b162" returned: 0 in 4.831s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:38 devstack cinder-volume[89331]: DEBUG cinder.image.image_utils [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d, size 1024.00 MB, duration 4.83 sec, destination /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c9f2ec42-6585-47ba-ba9a-8ac01715b162 {{(pid=89331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:21:38 devstack cinder-volume[89331]: INFO cinder.image.image_utils [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Converted 1024.00 MB image at 211.91 MB/s Sep 05 05:21:38 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c9f2ec42-6585-47ba-ba9a-8ac01715b162 is being set with open permissions: ugo+rw Sep 05 05:21:38 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c9f2ec42-6585-47ba-ba9a-8ac01715b162 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:39 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c9f2ec42-6585-47ba-ba9a-8ac01715b162 Sep 05 05:21:39 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:39 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c9f2ec42-6585-47ba-ba9a-8ac01715b162" returned: 0 in 0.242s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Lock "cinder-quobyte-c9f2ec42-6585-47ba-ba9a-8ac01715b162" released by "_copy_volume_from_snapshot" :: held 6.003s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Lock "cinder-quobyte-97c90ba8-feb3-4da0-ba0b-041e4bb14640-c9f2ec42-6585-47ba-ba9a-8ac01715b162" released by "_create_volume_from_snapshot" :: held 6.074s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.102s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.523s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1758592003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec00462f-f975-49b5-a08e-48ddca5b1560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad580cb1010b4899b3d6f4071f9a30c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:34Z,use_quota=True,user_id='777649d126094987b71ca3b21cd760a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Creating volume ec00462f-f975-49b5-a08e-48ddca5b1560 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:21:39 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:39 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560 1073741824 Sep 05 05:21:39 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6438c2-e905-47a8-b825-2a47dd613de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9f2ec42-6585-47ba-ba9a-8ac01715b162', 'volume_size': 1, 'snapshot_id': '97c90ba8-feb3-4da0-ba0b-041e4bb14640'}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c19d0f71-d446-4cdc-8737-01dcdf579f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:39 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Volume volume-c9f2ec42-6585-47ba-ba9a-8ac01715b162 (c9f2ec42-6585-47ba-ba9a-8ac01715b162): created successfully Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c19d0f71-d446-4cdc-8737-01dcdf579f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Flow 'volume_create_manager' (d45b1066-1c8f-4751-b489-f45f3e227916) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:39 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-ffc45f52-577d-4ec4-9ccb-34bdf51e97ca tempest-SnapshotDependencyTests-2008510584 None] Created volume successfully. Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e411bc72-1d5d-459f-8326-5c219e6cdecf tempest-SnapshotDependencyTests-2008510584 None] Acquiring lock "cinder-97c90ba8-feb3-4da0-ba0b-041e4bb14640-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e411bc72-1d5d-459f-8326-5c219e6cdecf tempest-SnapshotDependencyTests-2008510584 None] Lock "cinder-97c90ba8-feb3-4da0-ba0b-041e4bb14640-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e411bc72-1d5d-459f-8326-5c219e6cdecf tempest-SnapshotDependencyTests-2008510584 None] Acquiring lock "cinder-quobyte-113f5443-669e-4dcf-8a91-e24d436b515d" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e411bc72-1d5d-459f-8326-5c219e6cdecf tempest-SnapshotDependencyTests-2008510584 None] Lock "cinder-quobyte-113f5443-669e-4dcf-8a91-e24d436b515d" acquired by "delete_snapshot" :: waited 0.087s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e411bc72-1d5d-459f-8326-5c219e6cdecf tempest-SnapshotDependencyTests-2008510584 None] Acquiring lock "cinder-quobyte-97c90ba8-feb3-4da0-ba0b-041e4bb14640" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e411bc72-1d5d-459f-8326-5c219e6cdecf tempest-SnapshotDependencyTests-2008510584 None] Lock "cinder-quobyte-97c90ba8-feb3-4da0-ba0b-041e4bb14640" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-e411bc72-1d5d-459f-8326-5c219e6cdecf tempest-SnapshotDependencyTests-2008510584 None] Deleting offline snapshot 97c90ba8-feb3-4da0-ba0b-041e4bb14640 of volume 113f5443-669e-4dcf-8a91-e24d436b515d {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-e411bc72-1d5d-459f-8326-5c219e6cdecf tempest-SnapshotDependencyTests-2008510584 None] snapshot_file for this snap is: volume-113f5443-669e-4dcf-8a91-e24d436b515d.97c90ba8-feb3-4da0-ba0b-041e4bb14640 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f54176b-f1db-4ac3-81ab-f8aed5bd52d7]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e411bc72-1d5d-459f-8326-5c219e6cdecf tempest-SnapshotDependencyTests-2008510584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.97c90ba8-feb3-4da0-ba0b-041e4bb14640 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:39 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560 1073741824" returned: 0 in 0.632s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:39 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:39 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.97c90ba8-feb3-4da0-ba0b-041e4bb14640 Sep 05 05:21:40 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:40 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560 Sep 05 05:21:40 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:40 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560" returned: 0 in 0.317s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:40 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:21:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:40 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce70f72f-d37d-4868-a42a-723114273172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec00462f-f975-49b5-a08e-48ddca5b1560', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:40 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df3e042-9674-45e9-8eec-ae6fed75d272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:40 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e411bc72-1d5d-459f-8326-5c219e6cdecf tempest-SnapshotDependencyTests-2008510584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.97c90ba8-feb3-4da0-ba0b-041e4bb14640" returned: 0 in 0.466s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:40 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-e411bc72-1d5d-459f-8326-5c219e6cdecf tempest-SnapshotDependencyTests-2008510584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-113f5443-669e-4dcf-8a91-e24d436b515d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:21:40 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Volume volume-ec00462f-f975-49b5-a08e-48ddca5b1560 (ec00462f-f975-49b5-a08e-48ddca5b1560): created successfully Sep 05 05:21:40 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df3e042-9674-45e9-8eec-ae6fed75d272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:40 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Flow 'volume_create_manager' (e02092c5-c089-4636-98a0-c64b6dc19e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:40 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3860d09-e2a4-4862-ace6-041c8bcd46f0]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e411bc72-1d5d-459f-8326-5c219e6cdecf tempest-SnapshotDependencyTests-2008510584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:40 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-578e6f2e-1601-4f86-9b1c-26d1fba9bb30 tempest-ProjectMemberTests-1299516133 None] Created volume successfully. Sep 05 05:21:40 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d Sep 05 05:21:40 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:40 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e411bc72-1d5d-459f-8326-5c219e6cdecf tempest-SnapshotDependencyTests-2008510584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d" returned: 0 in 0.528s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:40 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e411bc72-1d5d-459f-8326-5c219e6cdecf tempest-SnapshotDependencyTests-2008510584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.97c90ba8-feb3-4da0-ba0b-041e4bb14640 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:40 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.97c90ba8-feb3-4da0-ba0b-041e4bb14640 Sep 05 05:21:40 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:41 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e411bc72-1d5d-459f-8326-5c219e6cdecf tempest-SnapshotDependencyTests-2008510584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.97c90ba8-feb3-4da0-ba0b-041e4bb14640" returned: 0 in 0.349s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e411bc72-1d5d-459f-8326-5c219e6cdecf tempest-SnapshotDependencyTests-2008510584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.97c90ba8-feb3-4da0-ba0b-041e4bb14640 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:41 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.97c90ba8-feb3-4da0-ba0b-041e4bb14640 Sep 05 05:21:41 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a2e91237-b868-4a49-8881-a10db70eafcb tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a2e91237-b868-4a49-8881-a10db70eafcb tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:41 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-e411bc72-1d5d-459f-8326-5c219e6cdecf tempest-SnapshotDependencyTests-2008510584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d.97c90ba8-feb3-4da0-ba0b-041e4bb14640" returned: 0 in 0.271s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:41 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-a2e91237-b868-4a49-8881-a10db70eafcb tempest-ProjectMemberTests-1299516133 None] Creating offline snapshot 490cf1da-852f-471d-b265-fca27f209c13 of volume ec00462f-f975-49b5-a08e-48ddca5b1560 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:21:41 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d2f644-7599-4005-a516-ab835ea52611]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:41 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a2e91237-b868-4a49-8881-a10db70eafcb tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e411bc72-1d5d-459f-8326-5c219e6cdecf tempest-SnapshotDependencyTests-2008510584 None] Lock "cinder-quobyte-97c90ba8-feb3-4da0-ba0b-041e4bb14640" released by "_delete_snapshot" :: held 1.775s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e411bc72-1d5d-459f-8326-5c219e6cdecf tempest-SnapshotDependencyTests-2008510584 None] Lock "cinder-quobyte-113f5443-669e-4dcf-8a91-e24d436b515d" released by "delete_snapshot" :: held 1.811s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:41 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-e411bc72-1d5d-459f-8326-5c219e6cdecf tempest-SnapshotDependencyTests-2008510584 None] Created reservations ['9ca533e0-9915-4f8b-97a5-3da797bac813', '711f7a4a-2d58-4dd7-ac98-958fadc4881a', '7e3105b6-2b8b-461f-b07f-b014446d51cc', 'a35ce2ff-b0df-4389-8cc0-1a42f9cb8174'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:41 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560 Sep 05 05:21:41 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:41 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-e411bc72-1d5d-459f-8326-5c219e6cdecf tempest-SnapshotDependencyTests-2008510584 None] Delete snapshot completed successfully. Sep 05 05:21:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-e411bc72-1d5d-459f-8326-5c219e6cdecf tempest-SnapshotDependencyTests-2008510584 None] Lock "cinder-97c90ba8-feb3-4da0-ba0b-041e4bb14640-delete_snapshot" released by "delete_snapshot" :: held 2.043s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f57b4fdf-31fa-486f-b344-ba5614ef43ca tempest-SnapshotDependencyTests-2008510584 None] Acquiring lock "cinder-113f5443-669e-4dcf-8a91-e24d436b515d-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f57b4fdf-31fa-486f-b344-ba5614ef43ca tempest-SnapshotDependencyTests-2008510584 None] Lock "cinder-113f5443-669e-4dcf-8a91-e24d436b515d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f57b4fdf-31fa-486f-b344-ba5614ef43ca tempest-SnapshotDependencyTests-2008510584 None] Acquiring lock "cinder-quobyte-113f5443-669e-4dcf-8a91-e24d436b515d" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:41 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f57b4fdf-31fa-486f-b344-ba5614ef43ca tempest-SnapshotDependencyTests-2008510584 None] Lock "cinder-quobyte-113f5443-669e-4dcf-8a91-e24d436b515d" acquired by "delete_volume" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4870fcff-88f4-4454-893f-28eb5409c353]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:42 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f57b4fdf-31fa-486f-b344-ba5614ef43ca tempest-SnapshotDependencyTests-2008510584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a2e91237-b868-4a49-8881-a10db70eafcb tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560" returned: 0 in 0.442s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a2e91237-b868-4a49-8881-a10db70eafcb tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.490cf1da-852f-471d-b265-fca27f209c13 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:42 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.490cf1da-852f-471d-b265-fca27f209c13 1G Sep 05 05:21:42 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:42 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d Sep 05 05:21:42 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:42 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f57b4fdf-31fa-486f-b344-ba5614ef43ca tempest-SnapshotDependencyTests-2008510584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d" returned: 0 in 0.435s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f57b4fdf-31fa-486f-b344-ba5614ef43ca tempest-SnapshotDependencyTests-2008510584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:42 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a2e91237-b868-4a49-8881-a10db70eafcb tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.490cf1da-852f-471d-b265-fca27f209c13 1G" returned: 0 in 0.437s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a2e91237-b868-4a49-8881-a10db70eafcb tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec00462f-f975-49b5-a08e-48ddca5b1560 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.490cf1da-852f-471d-b265-fca27f209c13 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:42 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d Sep 05 05:21:42 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:42 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec00462f-f975-49b5-a08e-48ddca5b1560 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.490cf1da-852f-471d-b265-fca27f209c13 Sep 05 05:21:42 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Flow 'volume_create_manager' (7039cc11-294a-4502-96ac-2ef177a09ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092e53aa-7920-44a0-9cf7-8e1bc0018221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092e53aa-7920-44a0-9cf7-8e1bc0018221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-491963362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d017a64-4b23-4e73-b456-a61d1a788f02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b74fefea323497aa14ea40273b9ae30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:43Z,use_quota=True,user_id='39522c219efb4bb08873aa449bbf2e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb34d1f-3a1d-462f-8fb1-ee5fe85920f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb34d1f-3a1d-462f-8fb1-ee5fe85920f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e88c6af-83d4-4ca9-866f-15a5ff19c834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e88c6af-83d4-4ca9-866f-15a5ff19c834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d017a64-4b23-4e73-b456-a61d1a788f02', 'volume_name': 'volume-0d017a64-4b23-4e73-b456-a61d1a788f02', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb48ce3c-9346-4334-bfc9-892cc75b4e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb48ce3c-9346-4334-bfc9-892cc75b4e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f135cf6-fb76-4d6b-9474-9e05c4c58b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:42 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:42 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Volume 0d017a64-4b23-4e73-b456-a61d1a788f02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d017a64-4b23-4e73-b456-a61d1a788f02', 'volume_size': 1} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f57b4fdf-31fa-486f-b344-ba5614ef43ca tempest-SnapshotDependencyTests-2008510584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-113f5443-669e-4dcf-8a91-e24d436b515d" returned: 0 in 0.253s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f57b4fdf-31fa-486f-b344-ba5614ef43ca tempest-SnapshotDependencyTests-2008510584 None] Lock "cinder-quobyte-113f5443-669e-4dcf-8a91-e24d436b515d" released by "delete_volume" :: held 0.748s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-f57b4fdf-31fa-486f-b344-ba5614ef43ca tempest-SnapshotDependencyTests-2008510584 None] Created reservations ['91418350-f6de-4a3a-b6ce-3e36acbb7be9', '83c9986f-1c95-4dd8-862f-b051eb353f4b', '6394d849-0c99-4354-a7e9-5ceab9cfc333', '5acb8f70-240a-475b-951f-11e9c72b70d2'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:42 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a2e91237-b868-4a49-8881-a10db70eafcb tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec00462f-f975-49b5-a08e-48ddca5b1560 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.490cf1da-852f-471d-b265-fca27f209c13" returned: 0 in 0.352s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:42 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-a2e91237-b868-4a49-8881-a10db70eafcb tempest-ProjectMemberTests-1299516133 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.490cf1da-852f-471d-b265-fca27f209c13 is being set with open permissions: ugo+rw Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a2e91237-b868-4a49-8881-a10db70eafcb tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.490cf1da-852f-471d-b265-fca27f209c13 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f57b4fdf-31fa-486f-b344-ba5614ef43ca tempest-SnapshotDependencyTests-2008510584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f57b4fdf-31fa-486f-b344-ba5614ef43ca tempest-SnapshotDependencyTests-2008510584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f57b4fdf-31fa-486f-b344-ba5614ef43ca tempest-SnapshotDependencyTests-2008510584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-f57b4fdf-31fa-486f-b344-ba5614ef43ca tempest-SnapshotDependencyTests-2008510584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-f57b4fdf-31fa-486f-b344-ba5614ef43ca tempest-SnapshotDependencyTests-2008510584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:42 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f57b4fdf-31fa-486f-b344-ba5614ef43ca tempest-SnapshotDependencyTests-2008510584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:42 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.490cf1da-852f-471d-b265-fca27f209c13 Sep 05 05:21:42 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:42 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:21:42 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:43 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a2e91237-b868-4a49-8881-a10db70eafcb tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.490cf1da-852f-471d-b265-fca27f209c13" returned: 0 in 0.254s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-92ea7b94-47a7-4daf-be72-754130b5832f tempest-SnapshotDependencyTests-2008510584 None] Acquiring lock "cinder-c9f2ec42-6585-47ba-ba9a-8ac01715b162-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:43 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f57b4fdf-31fa-486f-b344-ba5614ef43ca tempest-SnapshotDependencyTests-2008510584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.268s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-f57b4fdf-31fa-486f-b344-ba5614ef43ca tempest-SnapshotDependencyTests-2008510584 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-92ea7b94-47a7-4daf-be72-754130b5832f tempest-SnapshotDependencyTests-2008510584 None] Lock "cinder-c9f2ec42-6585-47ba-ba9a-8ac01715b162-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:43 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-f57b4fdf-31fa-486f-b344-ba5614ef43ca tempest-SnapshotDependencyTests-2008510584 None] Deleted volume successfully. Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a2e91237-b868-4a49-8881-a10db70eafcb tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:43 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.info Sep 05 05:21:43 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f57b4fdf-31fa-486f-b344-ba5614ef43ca tempest-SnapshotDependencyTests-2008510584 None] Lock "cinder-113f5443-669e-4dcf-8a91-e24d436b515d-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-92ea7b94-47a7-4daf-be72-754130b5832f tempest-SnapshotDependencyTests-2008510584 None] Acquiring lock "cinder-quobyte-c9f2ec42-6585-47ba-ba9a-8ac01715b162" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-92ea7b94-47a7-4daf-be72-754130b5832f tempest-SnapshotDependencyTests-2008510584 None] Lock "cinder-quobyte-c9f2ec42-6585-47ba-ba9a-8ac01715b162" acquired by "delete_volume" :: waited 0.013s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b7ad02-8a3b-44f7-8f50-384fb6dc7271]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-92ea7b94-47a7-4daf-be72-754130b5832f tempest-SnapshotDependencyTests-2008510584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c9f2ec42-6585-47ba-ba9a-8ac01715b162 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:43 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c9f2ec42-6585-47ba-ba9a-8ac01715b162 Sep 05 05:21:43 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:43 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a2e91237-b868-4a49-8881-a10db70eafcb tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.info" returned: 0 in 0.263s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:43 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-a2e91237-b868-4a49-8881-a10db70eafcb tempest-ProjectMemberTests-1299516133 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.info is being set with open permissions: ugo+rw Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a2e91237-b868-4a49-8881-a10db70eafcb tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:43 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.info Sep 05 05:21:43 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:43 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-92ea7b94-47a7-4daf-be72-754130b5832f tempest-SnapshotDependencyTests-2008510584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c9f2ec42-6585-47ba-ba9a-8ac01715b162" returned: 0 in 0.387s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-92ea7b94-47a7-4daf-be72-754130b5832f tempest-SnapshotDependencyTests-2008510584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c9f2ec42-6585-47ba-ba9a-8ac01715b162 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:43 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c9f2ec42-6585-47ba-ba9a-8ac01715b162 Sep 05 05:21:43 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:43 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-a2e91237-b868-4a49-8881-a10db70eafcb tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.info" returned: 0 in 0.256s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-a2e91237-b868-4a49-8881-a10db70eafcb tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.144s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.976s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-491963362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d017a64-4b23-4e73-b456-a61d1a788f02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b74fefea323497aa14ea40273b9ae30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:43Z,use_quota=True,user_id='39522c219efb4bb08873aa449bbf2e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Creating volume 0d017a64-4b23-4e73-b456-a61d1a788f02 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:21:43 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d017a64-4b23-4e73-b456-a61d1a788f02 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:43 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d017a64-4b23-4e73-b456-a61d1a788f02 1073741824 Sep 05 05:21:43 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:43 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-a2e91237-b868-4a49-8881-a10db70eafcb tempest-ProjectMemberTests-1299516133 None] Create snapshot completed successfully Sep 05 05:21:43 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-92ea7b94-47a7-4daf-be72-754130b5832f tempest-SnapshotDependencyTests-2008510584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-c9f2ec42-6585-47ba-ba9a-8ac01715b162" returned: 0 in 0.252s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-92ea7b94-47a7-4daf-be72-754130b5832f tempest-SnapshotDependencyTests-2008510584 None] Lock "cinder-quobyte-c9f2ec42-6585-47ba-ba9a-8ac01715b162" released by "delete_volume" :: held 0.672s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-92ea7b94-47a7-4daf-be72-754130b5832f tempest-SnapshotDependencyTests-2008510584 None] Created reservations ['ec6ca16e-69d3-4a3f-8b5d-2615ac3299ca', 'd44a14d2-bb5a-4f5a-8a7b-25a79e51fe74', 'b4ce07f5-4616-4c2f-8abc-a3feb4c8f116', '805d6a22-9a60-4c51-9742-c2a190b3fe78'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-92ea7b94-47a7-4daf-be72-754130b5832f tempest-SnapshotDependencyTests-2008510584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-92ea7b94-47a7-4daf-be72-754130b5832f tempest-SnapshotDependencyTests-2008510584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-92ea7b94-47a7-4daf-be72-754130b5832f tempest-SnapshotDependencyTests-2008510584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-92ea7b94-47a7-4daf-be72-754130b5832f tempest-SnapshotDependencyTests-2008510584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-92ea7b94-47a7-4daf-be72-754130b5832f tempest-SnapshotDependencyTests-2008510584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:43 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-92ea7b94-47a7-4daf-be72-754130b5832f tempest-SnapshotDependencyTests-2008510584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:44 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:21:44 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:44 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d017a64-4b23-4e73-b456-a61d1a788f02 1073741824" returned: 0 in 0.422s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d017a64-4b23-4e73-b456-a61d1a788f02 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:44 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d017a64-4b23-4e73-b456-a61d1a788f02 Sep 05 05:21:44 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:44 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-92ea7b94-47a7-4daf-be72-754130b5832f tempest-SnapshotDependencyTests-2008510584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.266s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-92ea7b94-47a7-4daf-be72-754130b5832f tempest-SnapshotDependencyTests-2008510584 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:21:44 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-92ea7b94-47a7-4daf-be72-754130b5832f tempest-SnapshotDependencyTests-2008510584 None] Deleted volume successfully. Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-92ea7b94-47a7-4daf-be72-754130b5832f tempest-SnapshotDependencyTests-2008510584 None] Lock "cinder-c9f2ec42-6585-47ba-ba9a-8ac01715b162-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:44 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d017a64-4b23-4e73-b456-a61d1a788f02" returned: 0 in 0.266s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f135cf6-fb76-4d6b-9474-9e05c4c58b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d017a64-4b23-4e73-b456-a61d1a788f02', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445a7cfc-4fa7-4393-b1f1-8dd20b9df227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:44 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Volume volume-0d017a64-4b23-4e73-b456-a61d1a788f02 (0d017a64-4b23-4e73-b456-a61d1a788f02): created successfully Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445a7cfc-4fa7-4393-b1f1-8dd20b9df227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Flow 'volume_create_manager' (7039cc11-294a-4502-96ac-2ef177a09ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:44 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-4c152339-b834-4a2d-aa54-a38a02660b92 tempest-ProjectReaderTests-1498354998 None] Created volume successfully. Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d9112fae-3139-492b-9bd2-ac7031173a99 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-490cf1da-852f-471d-b265-fca27f209c13-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d9112fae-3139-492b-9bd2-ac7031173a99 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-490cf1da-852f-471d-b265-fca27f209c13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d9112fae-3139-492b-9bd2-ac7031173a99 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-ec00462f-f975-49b5-a08e-48ddca5b1560" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d9112fae-3139-492b-9bd2-ac7031173a99 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-ec00462f-f975-49b5-a08e-48ddca5b1560" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d9112fae-3139-492b-9bd2-ac7031173a99 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-490cf1da-852f-471d-b265-fca27f209c13" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d9112fae-3139-492b-9bd2-ac7031173a99 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-490cf1da-852f-471d-b265-fca27f209c13" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-d9112fae-3139-492b-9bd2-ac7031173a99 tempest-ProjectMemberTests-1299516133 None] Deleting offline snapshot 490cf1da-852f-471d-b265-fca27f209c13 of volume ec00462f-f975-49b5-a08e-48ddca5b1560 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-d9112fae-3139-492b-9bd2-ac7031173a99 tempest-ProjectMemberTests-1299516133 None] snapshot_file for this snap is: volume-ec00462f-f975-49b5-a08e-48ddca5b1560.490cf1da-852f-471d-b265-fca27f209c13 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e061fba5-441c-4b1a-97b7-2f52d497958d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d9112fae-3139-492b-9bd2-ac7031173a99 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.490cf1da-852f-471d-b265-fca27f209c13 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-501950ad-1f5b-487f-9ef1-e4365df2b945 tempest-ProjectReaderTests-1498354998 None] Acquiring lock "cinder-0d017a64-4b23-4e73-b456-a61d1a788f02-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:44 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.490cf1da-852f-471d-b265-fca27f209c13 Sep 05 05:21:44 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:44 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-501950ad-1f5b-487f-9ef1-e4365df2b945 tempest-ProjectReaderTests-1498354998 None] Lock "cinder-0d017a64-4b23-4e73-b456-a61d1a788f02-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:45 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-501950ad-1f5b-487f-9ef1-e4365df2b945 tempest-ProjectReaderTests-1498354998 None] Acquiring lock "cinder-quobyte-0d017a64-4b23-4e73-b456-a61d1a788f02" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:45 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-501950ad-1f5b-487f-9ef1-e4365df2b945 tempest-ProjectReaderTests-1498354998 None] Lock "cinder-quobyte-0d017a64-4b23-4e73-b456-a61d1a788f02" acquired by "delete_volume" :: waited 0.017s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:45 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90ff1d7-d6ca-4580-8159-25ab64c5d45d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-501950ad-1f5b-487f-9ef1-e4365df2b945 tempest-ProjectReaderTests-1498354998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d017a64-4b23-4e73-b456-a61d1a788f02 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:45 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d017a64-4b23-4e73-b456-a61d1a788f02 Sep 05 05:21:45 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:45 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d9112fae-3139-492b-9bd2-ac7031173a99 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.490cf1da-852f-471d-b265-fca27f209c13" returned: 0 in 0.451s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:45 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-d9112fae-3139-492b-9bd2-ac7031173a99 tempest-ProjectMemberTests-1299516133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec00462f-f975-49b5-a08e-48ddca5b1560(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:21:45 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8132c63-4652-4cc2-af10-64b7eee815a6]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d9112fae-3139-492b-9bd2-ac7031173a99 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:45 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560 Sep 05 05:21:45 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:45 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-501950ad-1f5b-487f-9ef1-e4365df2b945 tempest-ProjectReaderTests-1498354998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d017a64-4b23-4e73-b456-a61d1a788f02" returned: 0 in 0.436s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-501950ad-1f5b-487f-9ef1-e4365df2b945 tempest-ProjectReaderTests-1498354998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d017a64-4b23-4e73-b456-a61d1a788f02 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:45 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d017a64-4b23-4e73-b456-a61d1a788f02 Sep 05 05:21:45 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:45 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d9112fae-3139-492b-9bd2-ac7031173a99 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560" returned: 0 in 0.409s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d9112fae-3139-492b-9bd2-ac7031173a99 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.490cf1da-852f-471d-b265-fca27f209c13 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:45 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.490cf1da-852f-471d-b265-fca27f209c13 Sep 05 05:21:45 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:45 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-501950ad-1f5b-487f-9ef1-e4365df2b945 tempest-ProjectReaderTests-1498354998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-0d017a64-4b23-4e73-b456-a61d1a788f02" returned: 0 in 0.297s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:45 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-501950ad-1f5b-487f-9ef1-e4365df2b945 tempest-ProjectReaderTests-1498354998 None] Lock "cinder-quobyte-0d017a64-4b23-4e73-b456-a61d1a788f02" released by "delete_volume" :: held 0.786s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:45 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-501950ad-1f5b-487f-9ef1-e4365df2b945 tempest-ProjectReaderTests-1498354998 None] Created reservations ['63f85c7b-adcf-4fb6-a382-f74a6314c199', '83e7d111-cf54-45ce-8454-83e8f045fde6', 'a020dbf0-9f09-4c13-b048-ccf9c77e89ed', 'a75efee3-e7a0-4537-8bc9-7c8fddc751f8'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-501950ad-1f5b-487f-9ef1-e4365df2b945 tempest-ProjectReaderTests-1498354998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-501950ad-1f5b-487f-9ef1-e4365df2b945 tempest-ProjectReaderTests-1498354998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:45 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-501950ad-1f5b-487f-9ef1-e4365df2b945 tempest-ProjectReaderTests-1498354998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:45 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-501950ad-1f5b-487f-9ef1-e4365df2b945 tempest-ProjectReaderTests-1498354998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-501950ad-1f5b-487f-9ef1-e4365df2b945 tempest-ProjectReaderTests-1498354998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:45 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-501950ad-1f5b-487f-9ef1-e4365df2b945 tempest-ProjectReaderTests-1498354998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:46 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:21:46 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:46 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d9112fae-3139-492b-9bd2-ac7031173a99 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.490cf1da-852f-471d-b265-fca27f209c13" returned: 0 in 0.443s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d9112fae-3139-492b-9bd2-ac7031173a99 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.490cf1da-852f-471d-b265-fca27f209c13 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:46 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.490cf1da-852f-471d-b265-fca27f209c13 Sep 05 05:21:46 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:46 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-501950ad-1f5b-487f-9ef1-e4365df2b945 tempest-ProjectReaderTests-1498354998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.325s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-501950ad-1f5b-487f-9ef1-e4365df2b945 tempest-ProjectReaderTests-1498354998 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:21:46 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-501950ad-1f5b-487f-9ef1-e4365df2b945 tempest-ProjectReaderTests-1498354998 None] Deleted volume successfully. Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-501950ad-1f5b-487f-9ef1-e4365df2b945 tempest-ProjectReaderTests-1498354998 None] Lock "cinder-0d017a64-4b23-4e73-b456-a61d1a788f02-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:46 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d9112fae-3139-492b-9bd2-ac7031173a99 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560.490cf1da-852f-471d-b265-fca27f209c13" returned: 0 in 0.290s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d9112fae-3139-492b-9bd2-ac7031173a99 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-490cf1da-852f-471d-b265-fca27f209c13" released by "_delete_snapshot" :: held 1.708s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d9112fae-3139-492b-9bd2-ac7031173a99 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-ec00462f-f975-49b5-a08e-48ddca5b1560" released by "delete_snapshot" :: held 1.746s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-d9112fae-3139-492b-9bd2-ac7031173a99 tempest-ProjectMemberTests-1299516133 None] Created reservations ['10ad8302-1279-4fce-b61c-acd6053b4c14', '2a9fd8a9-ec23-4e4b-9bb6-55b35d2fdd52', 'f561238d-fadf-455f-a177-4ede4d44dee6', '973f7fce-519a-4f70-9794-a06085ac7148'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:46 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-d9112fae-3139-492b-9bd2-ac7031173a99 tempest-ProjectMemberTests-1299516133 None] Delete snapshot completed successfully. Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Flow 'volume_create_manager' (e1519a50-013e-474c-abbe-3a2e10f6abc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1065e7-b91c-4be1-a455-87f0099ea17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d9112fae-3139-492b-9bd2-ac7031173a99 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-490cf1da-852f-471d-b265-fca27f209c13-delete_snapshot" released by "delete_snapshot" :: held 1.956s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1065e7-b91c-4be1-a455-87f0099ea17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-700799513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d5482c8-eb80-4ed5-b636-b114441c065a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b74fefea323497aa14ea40273b9ae30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:47Z,use_quota=True,user_id='39522c219efb4bb08873aa449bbf2e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b6c4b9-8885-42e8-b902-e5c96457a81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b6c4b9-8885-42e8-b902-e5c96457a81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b460319-18ca-4285-9166-b0fdd19da006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b460319-18ca-4285-9166-b0fdd19da006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d5482c8-eb80-4ed5-b636-b114441c065a', 'volume_name': 'volume-6d5482c8-eb80-4ed5-b636-b114441c065a', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc8edbb-12b2-4e15-8486-00e0828782b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc8edbb-12b2-4e15-8486-00e0828782b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4bd158-d3b8-47ed-ba1f-abf18afbb000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:46 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Volume 6d5482c8-eb80-4ed5-b636-b114441c065a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d5482c8-eb80-4ed5-b636-b114441c065a', 'volume_size': 1} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-700799513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d5482c8-eb80-4ed5-b636-b114441c065a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b74fefea323497aa14ea40273b9ae30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:47Z,use_quota=True,user_id='39522c219efb4bb08873aa449bbf2e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Creating volume 6d5482c8-eb80-4ed5-b636-b114441c065a {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:21:46 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d5482c8-eb80-4ed5-b636-b114441c065a 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:46 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d5482c8-eb80-4ed5-b636-b114441c065a 1073741824 Sep 05 05:21:46 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1f317612-c4a6-4416-8e97-185013e11232 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-ec00462f-f975-49b5-a08e-48ddca5b1560-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1f317612-c4a6-4416-8e97-185013e11232 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-ec00462f-f975-49b5-a08e-48ddca5b1560-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1f317612-c4a6-4416-8e97-185013e11232 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-ec00462f-f975-49b5-a08e-48ddca5b1560" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:46 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1f317612-c4a6-4416-8e97-185013e11232 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-ec00462f-f975-49b5-a08e-48ddca5b1560" acquired by "delete_volume" :: waited 0.021s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:47 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f38bcf-77e9-43db-b6d6-eca32582f196]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f317612-c4a6-4416-8e97-185013e11232 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:47 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560 Sep 05 05:21:47 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:47 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d5482c8-eb80-4ed5-b636-b114441c065a 1073741824" returned: 0 in 0.497s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d5482c8-eb80-4ed5-b636-b114441c065a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:47 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d5482c8-eb80-4ed5-b636-b114441c065a Sep 05 05:21:47 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:47 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f317612-c4a6-4416-8e97-185013e11232 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560" returned: 0 in 0.428s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f317612-c4a6-4416-8e97-185013e11232 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:47 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560 Sep 05 05:21:47 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:47 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d5482c8-eb80-4ed5-b636-b114441c065a" returned: 0 in 0.274s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:21:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4bd158-d3b8-47ed-ba1f-abf18afbb000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d5482c8-eb80-4ed5-b636-b114441c065a', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcfcda91-959c-40b9-a662-704df622f8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:47 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Volume volume-6d5482c8-eb80-4ed5-b636-b114441c065a (6d5482c8-eb80-4ed5-b636-b114441c065a): created successfully Sep 05 05:21:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcfcda91-959c-40b9-a662-704df622f8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:47 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Flow 'volume_create_manager' (e1519a50-013e-474c-abbe-3a2e10f6abc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:47 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-5420e06e-1491-460b-b0e3-854d6c73bc50 tempest-ProjectReaderTests-1498354998 None] Created volume successfully. Sep 05 05:21:47 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f317612-c4a6-4416-8e97-185013e11232 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-ec00462f-f975-49b5-a08e-48ddca5b1560" returned: 0 in 0.251s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:47 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1f317612-c4a6-4416-8e97-185013e11232 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-ec00462f-f975-49b5-a08e-48ddca5b1560" released by "delete_volume" :: held 0.736s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:47 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-1f317612-c4a6-4416-8e97-185013e11232 tempest-ProjectMemberTests-1299516133 None] Created reservations ['6435e165-f766-4857-b2ba-2bebc3e18148', '38400a2f-cdfa-4052-b085-159fb1517885', '5a0a2103-0fc6-4f78-bf45-591ac9722605', 'a6a8db3c-98e3-46ec-967d-636f0553bffa'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1f317612-c4a6-4416-8e97-185013e11232 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1f317612-c4a6-4416-8e97-185013e11232 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-1f317612-c4a6-4416-8e97-185013e11232 tempest-ProjectMemberTests-1299516133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:47 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-1f317612-c4a6-4416-8e97-185013e11232 tempest-ProjectMemberTests-1299516133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1f317612-c4a6-4416-8e97-185013e11232 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:47 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f317612-c4a6-4416-8e97-185013e11232 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:47 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:21:47 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:48 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1f317612-c4a6-4416-8e97-185013e11232 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.245s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-1f317612-c4a6-4416-8e97-185013e11232 tempest-ProjectMemberTests-1299516133 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:21:48 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-1f317612-c4a6-4416-8e97-185013e11232 tempest-ProjectMemberTests-1299516133 None] Deleted volume successfully. Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1f317612-c4a6-4416-8e97-185013e11232 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-ec00462f-f975-49b5-a08e-48ddca5b1560-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Flow 'volume_create_manager' (c56f2b6a-5c87-4ed3-a022-c337e556b46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f53cfdb-91c0-424b-b9cd-0de4a2ed239a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f53cfdb-91c0-424b-b9cd-0de4a2ed239a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-798453544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00fdd1e1-367e-4575-97ca-2b2df9b5baf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad580cb1010b4899b3d6f4071f9a30c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:49Z,use_quota=True,user_id='777649d126094987b71ca3b21cd760a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2db430d-6c0f-4f86-a567-3384ecb4360f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2db430d-6c0f-4f86-a567-3384ecb4360f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (267f5411-0ded-4fb1-8f1c-79c581a4d9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (267f5411-0ded-4fb1-8f1c-79c581a4d9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00fdd1e1-367e-4575-97ca-2b2df9b5baf0', 'volume_name': 'volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77226d5d-2a45-496e-ac77-45798405fecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77226d5d-2a45-496e-ac77-45798405fecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb733cc0-8c36-41e8-9af4-f033c35f28b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:48 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Volume 00fdd1e1-367e-4575-97ca-2b2df9b5baf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0', 'volume_size': 1} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-798453544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00fdd1e1-367e-4575-97ca-2b2df9b5baf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad580cb1010b4899b3d6f4071f9a30c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:49Z,use_quota=True,user_id='777649d126094987b71ca3b21cd760a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Creating volume 00fdd1e1-367e-4575-97ca-2b2df9b5baf0 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:21:48 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:48 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0 1073741824 Sep 05 05:21:48 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9275b9f7-8fb1-4772-b3c1-77fccea04445 tempest-ProjectReaderTests-1498354998 None] Acquiring lock "cinder-6d5482c8-eb80-4ed5-b636-b114441c065a-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9275b9f7-8fb1-4772-b3c1-77fccea04445 tempest-ProjectReaderTests-1498354998 None] Lock "cinder-6d5482c8-eb80-4ed5-b636-b114441c065a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9275b9f7-8fb1-4772-b3c1-77fccea04445 tempest-ProjectReaderTests-1498354998 None] Acquiring lock "cinder-quobyte-6d5482c8-eb80-4ed5-b636-b114441c065a" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9275b9f7-8fb1-4772-b3c1-77fccea04445 tempest-ProjectReaderTests-1498354998 None] Lock "cinder-quobyte-6d5482c8-eb80-4ed5-b636-b114441c065a" acquired by "delete_volume" :: waited 0.022s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[be978fdd-19be-49de-ab41-f9cb21ac438f]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:48 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9275b9f7-8fb1-4772-b3c1-77fccea04445 tempest-ProjectReaderTests-1498354998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d5482c8-eb80-4ed5-b636-b114441c065a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:49 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d5482c8-eb80-4ed5-b636-b114441c065a Sep 05 05:21:49 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:49 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0 1073741824" returned: 0 in 0.515s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:49 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0 Sep 05 05:21:49 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:49 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9275b9f7-8fb1-4772-b3c1-77fccea04445 tempest-ProjectReaderTests-1498354998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d5482c8-eb80-4ed5-b636-b114441c065a" returned: 0 in 0.478s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9275b9f7-8fb1-4772-b3c1-77fccea04445 tempest-ProjectReaderTests-1498354998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d5482c8-eb80-4ed5-b636-b114441c065a {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:49 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d5482c8-eb80-4ed5-b636-b114441c065a Sep 05 05:21:49 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:49 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0" returned: 0 in 0.285s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb733cc0-8c36-41e8-9af4-f033c35f28b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c678518e-4de7-4e5e-abc7-0f4cb53a7113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:49 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Volume volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0 (00fdd1e1-367e-4575-97ca-2b2df9b5baf0): created successfully Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c678518e-4de7-4e5e-abc7-0f4cb53a7113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Flow 'volume_create_manager' (c56f2b6a-5c87-4ed3-a022-c337e556b46a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:49 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-98106f49-fee4-46b8-978f-902e5cc6cf10 tempest-ProjectMemberTests-1299516133 None] Created volume successfully. Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:49 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:21:49 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:49 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9275b9f7-8fb1-4772-b3c1-77fccea04445 tempest-ProjectReaderTests-1498354998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6d5482c8-eb80-4ed5-b636-b114441c065a" returned: 0 in 0.302s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9275b9f7-8fb1-4772-b3c1-77fccea04445 tempest-ProjectReaderTests-1498354998 None] Lock "cinder-quobyte-6d5482c8-eb80-4ed5-b636-b114441c065a" released by "delete_volume" :: held 0.849s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-9275b9f7-8fb1-4772-b3c1-77fccea04445 tempest-ProjectReaderTests-1498354998 None] Created reservations ['31976e7a-f550-4b43-a3f1-244dcec26428', 'a9a6968c-9f38-46cb-a4f9-5e1d64425bcc', '3fca9422-630c-4b0d-bc6b-66c28f3b339d', 'bd6ff09e-0c40-47a5-a143-9116f360566b'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9275b9f7-8fb1-4772-b3c1-77fccea04445 tempest-ProjectReaderTests-1498354998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9275b9f7-8fb1-4772-b3c1-77fccea04445 tempest-ProjectReaderTests-1498354998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9275b9f7-8fb1-4772-b3c1-77fccea04445 tempest-ProjectReaderTests-1498354998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-9275b9f7-8fb1-4772-b3c1-77fccea04445 tempest-ProjectReaderTests-1498354998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-9275b9f7-8fb1-4772-b3c1-77fccea04445 tempest-ProjectReaderTests-1498354998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9275b9f7-8fb1-4772-b3c1-77fccea04445 tempest-ProjectReaderTests-1498354998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:49 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:21:49 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:49 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.297s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager._thread_info {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:21:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread count: 29 {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread info: [<_MainThread(MainThread, started 139182109970560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 05:21:50 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-9275b9f7-8fb1-4772-b3c1-77fccea04445 tempest-ProjectReaderTests-1498354998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.298s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-9275b9f7-8fb1-4772-b3c1-77fccea04445 tempest-ProjectReaderTests-1498354998 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:21:50 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-9275b9f7-8fb1-4772-b3c1-77fccea04445 tempest-ProjectReaderTests-1498354998 None] Deleted volume successfully. Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-9275b9f7-8fb1-4772-b3c1-77fccea04445 tempest-ProjectReaderTests-1498354998 None] Lock "cinder-6d5482c8-eb80-4ed5-b636-b114441c065a-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Flow 'volume_create_manager' (b40b547c-33c2-4f81-b623-163944ff0568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cffe91d-b810-43ad-bd10-46d3f9a9ad41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cffe91d-b810-43ad-bd10-46d3f9a9ad41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1924304144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9abcee22-1ea4-49be-b6da-a481718d166b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b74fefea323497aa14ea40273b9ae30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:50Z,use_quota=True,user_id='39522c219efb4bb08873aa449bbf2e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc1826b-3719-484b-805e-de4f2134d614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc1826b-3719-484b-805e-de4f2134d614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3257bd1-d5d4-415c-8cc2-a9b12b7fa7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3257bd1-d5d4-415c-8cc2-a9b12b7fa7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9abcee22-1ea4-49be-b6da-a481718d166b', 'volume_name': 'volume-9abcee22-1ea4-49be-b6da-a481718d166b', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6452a1a3-417f-447e-b33e-641cba961f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6452a1a3-417f-447e-b33e-641cba961f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd4f20e-dc7c-4c66-b0be-71db4398fc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:50 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Volume 9abcee22-1ea4-49be-b6da-a481718d166b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9abcee22-1ea4-49be-b6da-a481718d166b', 'volume_size': 1} Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1924304144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9abcee22-1ea4-49be-b6da-a481718d166b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b74fefea323497aa14ea40273b9ae30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:50Z,use_quota=True,user_id='39522c219efb4bb08873aa449bbf2e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Creating volume 9abcee22-1ea4-49be-b6da-a481718d166b {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:21:50 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9abcee22-1ea4-49be-b6da-a481718d166b 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:50 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9abcee22-1ea4-49be-b6da-a481718d166b 1073741824 Sep 05 05:21:50 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:50 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-41477908-a26d-4d61-af0f-268c594b58a6 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:51 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9abcee22-1ea4-49be-b6da-a481718d166b 1073741824" returned: 0 in 0.476s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9abcee22-1ea4-49be-b6da-a481718d166b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:51 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9abcee22-1ea4-49be-b6da-a481718d166b Sep 05 05:21:51 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:51 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9abcee22-1ea4-49be-b6da-a481718d166b" returned: 0 in 0.259s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:21:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-41477908-a26d-4d61-af0f-268c594b58a6 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.519s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd4f20e-dc7c-4c66-b0be-71db4398fc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9abcee22-1ea4-49be-b6da-a481718d166b', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce065354-6875-47f4-aa53-5e02e86acb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:51 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-41477908-a26d-4d61-af0f-268c594b58a6 tempest-ProjectMemberTests-1299516133 None] Creating offline snapshot c3b9b237-339a-45d3-9562-ec44e1c459ce of volume 00fdd1e1-367e-4575-97ca-2b2df9b5baf0 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:21:51 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Volume volume-9abcee22-1ea4-49be-b6da-a481718d166b (9abcee22-1ea4-49be-b6da-a481718d166b): created successfully Sep 05 05:21:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce065354-6875-47f4-aa53-5e02e86acb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:51 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Flow 'volume_create_manager' (b40b547c-33c2-4f81-b623-163944ff0568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:51 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f194f7e7-adeb-4338-9c6b-497f8f469e19]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-41477908-a26d-4d61-af0f-268c594b58a6 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:51 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-dfb45747-83d0-4d82-bab2-5958ad97e912 tempest-ProjectReaderTests-1498354998 None] Created volume successfully. Sep 05 05:21:51 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0 Sep 05 05:21:51 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:51 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-41477908-a26d-4d61-af0f-268c594b58a6 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0" returned: 0 in 0.393s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:51 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-41477908-a26d-4d61-af0f-268c594b58a6 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.c3b9b237-339a-45d3-9562-ec44e1c459ce 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:51 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.c3b9b237-339a-45d3-9562-ec44e1c459ce 1G Sep 05 05:21:51 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:52 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-41477908-a26d-4d61-af0f-268c594b58a6 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.c3b9b237-339a-45d3-9562-ec44e1c459ce 1G" returned: 0 in 0.408s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-41477908-a26d-4d61-af0f-268c594b58a6 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.c3b9b237-339a-45d3-9562-ec44e1c459ce {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:52 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.c3b9b237-339a-45d3-9562-ec44e1c459ce Sep 05 05:21:52 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:52 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-41477908-a26d-4d61-af0f-268c594b58a6 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.c3b9b237-339a-45d3-9562-ec44e1c459ce" returned: 0 in 0.285s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:52 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-41477908-a26d-4d61-af0f-268c594b58a6 tempest-ProjectMemberTests-1299516133 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.c3b9b237-339a-45d3-9562-ec44e1c459ce is being set with open permissions: ugo+rw Sep 05 05:21:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-41477908-a26d-4d61-af0f-268c594b58a6 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.c3b9b237-339a-45d3-9562-ec44e1c459ce {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:52 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.c3b9b237-339a-45d3-9562-ec44e1c459ce Sep 05 05:21:52 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-37d44474-d9c4-4a65-b180-3b3023d6905a tempest-ProjectReaderTests-1498354998 None] Acquiring lock "cinder-9abcee22-1ea4-49be-b6da-a481718d166b-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-37d44474-d9c4-4a65-b180-3b3023d6905a tempest-ProjectReaderTests-1498354998 None] Lock "cinder-9abcee22-1ea4-49be-b6da-a481718d166b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-37d44474-d9c4-4a65-b180-3b3023d6905a tempest-ProjectReaderTests-1498354998 None] Acquiring lock "cinder-quobyte-9abcee22-1ea4-49be-b6da-a481718d166b" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:52 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-37d44474-d9c4-4a65-b180-3b3023d6905a tempest-ProjectReaderTests-1498354998 None] Lock "cinder-quobyte-9abcee22-1ea4-49be-b6da-a481718d166b" acquired by "delete_volume" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:52 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a51ddf-005d-453f-9e17-f35e717abd1b]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-37d44474-d9c4-4a65-b180-3b3023d6905a tempest-ProjectReaderTests-1498354998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9abcee22-1ea4-49be-b6da-a481718d166b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:52 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-41477908-a26d-4d61-af0f-268c594b58a6 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.c3b9b237-339a-45d3-9562-ec44e1c459ce" returned: 0 in 0.277s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:52 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-41477908-a26d-4d61-af0f-268c594b58a6 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:52 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.info Sep 05 05:21:52 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:52 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9abcee22-1ea4-49be-b6da-a481718d166b Sep 05 05:21:52 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:53 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-41477908-a26d-4d61-af0f-268c594b58a6 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.info" returned: 0 in 0.343s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:53 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-41477908-a26d-4d61-af0f-268c594b58a6 tempest-ProjectMemberTests-1299516133 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.info is being set with open permissions: ugo+rw Sep 05 05:21:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-41477908-a26d-4d61-af0f-268c594b58a6 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:53 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.info Sep 05 05:21:53 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:53 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-37d44474-d9c4-4a65-b180-3b3023d6905a tempest-ProjectReaderTests-1498354998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9abcee22-1ea4-49be-b6da-a481718d166b" returned: 0 in 0.457s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-37d44474-d9c4-4a65-b180-3b3023d6905a tempest-ProjectReaderTests-1498354998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9abcee22-1ea4-49be-b6da-a481718d166b {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:53 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9abcee22-1ea4-49be-b6da-a481718d166b Sep 05 05:21:53 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:53 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-41477908-a26d-4d61-af0f-268c594b58a6 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.info" returned: 0 in 0.272s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-41477908-a26d-4d61-af0f-268c594b58a6 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.105s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:53 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-41477908-a26d-4d61-af0f-268c594b58a6 tempest-ProjectMemberTests-1299516133 None] Create snapshot completed successfully Sep 05 05:21:53 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-37d44474-d9c4-4a65-b180-3b3023d6905a tempest-ProjectReaderTests-1498354998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-9abcee22-1ea4-49be-b6da-a481718d166b" returned: 0 in 0.277s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:53 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-37d44474-d9c4-4a65-b180-3b3023d6905a tempest-ProjectReaderTests-1498354998 None] Lock "cinder-quobyte-9abcee22-1ea4-49be-b6da-a481718d166b" released by "delete_volume" :: held 0.783s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:53 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-37d44474-d9c4-4a65-b180-3b3023d6905a tempest-ProjectReaderTests-1498354998 None] Created reservations ['6e8e7f29-e5f7-4943-9d1c-6aaa01f2b333', '2177c5c1-f1f8-4ce4-9da4-e432bde40d6e', '16c6f715-eb23-4009-9fd0-f384d4801b01', '48297f18-825e-4cdf-bcb8-5f21f11d0760'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-37d44474-d9c4-4a65-b180-3b3023d6905a tempest-ProjectReaderTests-1498354998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-37d44474-d9c4-4a65-b180-3b3023d6905a tempest-ProjectReaderTests-1498354998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-37d44474-d9c4-4a65-b180-3b3023d6905a tempest-ProjectReaderTests-1498354998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:53 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-37d44474-d9c4-4a65-b180-3b3023d6905a tempest-ProjectReaderTests-1498354998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-37d44474-d9c4-4a65-b180-3b3023d6905a tempest-ProjectReaderTests-1498354998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:53 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-37d44474-d9c4-4a65-b180-3b3023d6905a tempest-ProjectReaderTests-1498354998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:53 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:21:53 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:54 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-37d44474-d9c4-4a65-b180-3b3023d6905a tempest-ProjectReaderTests-1498354998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.326s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-37d44474-d9c4-4a65-b180-3b3023d6905a tempest-ProjectReaderTests-1498354998 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:21:54 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-37d44474-d9c4-4a65-b180-3b3023d6905a tempest-ProjectReaderTests-1498354998 None] Deleted volume successfully. Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-37d44474-d9c4-4a65-b180-3b3023d6905a tempest-ProjectReaderTests-1498354998 None] Lock "cinder-9abcee22-1ea4-49be-b6da-a481718d166b-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c5f562a7-c4c9-412c-a6c4-436bdae25492 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-c3b9b237-339a-45d3-9562-ec44e1c459ce-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c5f562a7-c4c9-412c-a6c4-436bdae25492 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-c3b9b237-339a-45d3-9562-ec44e1c459ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c5f562a7-c4c9-412c-a6c4-436bdae25492 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-00fdd1e1-367e-4575-97ca-2b2df9b5baf0" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c5f562a7-c4c9-412c-a6c4-436bdae25492 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-00fdd1e1-367e-4575-97ca-2b2df9b5baf0" acquired by "delete_snapshot" :: waited 0.032s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c5f562a7-c4c9-412c-a6c4-436bdae25492 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-c3b9b237-339a-45d3-9562-ec44e1c459ce" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c5f562a7-c4c9-412c-a6c4-436bdae25492 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-c3b9b237-339a-45d3-9562-ec44e1c459ce" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-c5f562a7-c4c9-412c-a6c4-436bdae25492 tempest-ProjectMemberTests-1299516133 None] Deleting offline snapshot c3b9b237-339a-45d3-9562-ec44e1c459ce of volume 00fdd1e1-367e-4575-97ca-2b2df9b5baf0 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-c5f562a7-c4c9-412c-a6c4-436bdae25492 tempest-ProjectMemberTests-1299516133 None] snapshot_file for this snap is: volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.c3b9b237-339a-45d3-9562-ec44e1c459ce {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c57da2-53a9-4521-96fe-8a6e566cabbc]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c5f562a7-c4c9-412c-a6c4-436bdae25492 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.c3b9b237-339a-45d3-9562-ec44e1c459ce {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:54 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.c3b9b237-339a-45d3-9562-ec44e1c459ce Sep 05 05:21:54 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Flow 'volume_create_manager' (f92be9b6-1b66-47a6-88c0-a8f0feffcc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da121d68-a9f8-44d6-994a-d370515c15a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da121d68-a9f8-44d6-994a-d370515c15a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-593224110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de2cad6-99bc-431e-8436-6a8cbba65d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b74fefea323497aa14ea40273b9ae30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:54Z,use_quota=True,user_id='39522c219efb4bb08873aa449bbf2e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c374b66-4367-42f4-b05c-daa965d9c72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c374b66-4367-42f4-b05c-daa965d9c72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df3b9f3-6de3-44a4-9bbb-67d15c271d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df3b9f3-6de3-44a4-9bbb-67d15c271d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6de2cad6-99bc-431e-8436-6a8cbba65d23', 'volume_name': 'volume-6de2cad6-99bc-431e-8436-6a8cbba65d23', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a2047b-c329-42b8-8db5-6406d887665c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a2047b-c329-42b8-8db5-6406d887665c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6c00f3d-bc61-4a34-a3e8-5b93171b0395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:54 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Volume 6de2cad6-99bc-431e-8436-6a8cbba65d23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6de2cad6-99bc-431e-8436-6a8cbba65d23', 'volume_size': 1} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-593224110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de2cad6-99bc-431e-8436-6a8cbba65d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b74fefea323497aa14ea40273b9ae30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:54Z,use_quota=True,user_id='39522c219efb4bb08873aa449bbf2e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Creating volume 6de2cad6-99bc-431e-8436-6a8cbba65d23 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:21:54 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6de2cad6-99bc-431e-8436-6a8cbba65d23 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:54 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6de2cad6-99bc-431e-8436-6a8cbba65d23 1073741824 Sep 05 05:21:54 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:54 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c5f562a7-c4c9-412c-a6c4-436bdae25492 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.c3b9b237-339a-45d3-9562-ec44e1c459ce" returned: 0 in 0.406s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-c5f562a7-c4c9-412c-a6c4-436bdae25492 tempest-ProjectMemberTests-1299516133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[89baa7a2-bbf0-4008-8899-101e25da5a07]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:54 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c5f562a7-c4c9-412c-a6c4-436bdae25492 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:54 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0 Sep 05 05:21:54 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:55 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6de2cad6-99bc-431e-8436-6a8cbba65d23 1073741824" returned: 0 in 0.507s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:55 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c5f562a7-c4c9-412c-a6c4-436bdae25492 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0" returned: 0 in 0.415s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c5f562a7-c4c9-412c-a6c4-436bdae25492 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.c3b9b237-339a-45d3-9562-ec44e1c459ce {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6de2cad6-99bc-431e-8436-6a8cbba65d23 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:55 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.c3b9b237-339a-45d3-9562-ec44e1c459ce Sep 05 05:21:55 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:55 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6de2cad6-99bc-431e-8436-6a8cbba65d23 Sep 05 05:21:55 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:55 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6de2cad6-99bc-431e-8436-6a8cbba65d23" returned: 0 in 0.277s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:55 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:21:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6c00f3d-bc61-4a34-a3e8-5b93171b0395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6de2cad6-99bc-431e-8436-6a8cbba65d23', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12970978-a899-4a70-a8e2-6c50ac170981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:55 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Volume volume-6de2cad6-99bc-431e-8436-6a8cbba65d23 (6de2cad6-99bc-431e-8436-6a8cbba65d23): created successfully Sep 05 05:21:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12970978-a899-4a70-a8e2-6c50ac170981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:55 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Flow 'volume_create_manager' (f92be9b6-1b66-47a6-88c0-a8f0feffcc28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:55 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:55 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-d9469fb9-56e4-4b41-b6a3-a9d07405b19f tempest-ProjectReaderTests-1498354998 None] Created volume successfully. Sep 05 05:21:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c5f562a7-c4c9-412c-a6c4-436bdae25492 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.c3b9b237-339a-45d3-9562-ec44e1c459ce" returned: 0 in 0.370s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c5f562a7-c4c9-412c-a6c4-436bdae25492 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.c3b9b237-339a-45d3-9562-ec44e1c459ce {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:55 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.c3b9b237-339a-45d3-9562-ec44e1c459ce Sep 05 05:21:55 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:55 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:55 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-c5f562a7-c4c9-412c-a6c4-436bdae25492 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0.c3b9b237-339a-45d3-9562-ec44e1c459ce" returned: 0 in 0.269s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:55 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c5f562a7-c4c9-412c-a6c4-436bdae25492 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-c3b9b237-339a-45d3-9562-ec44e1c459ce" released by "_delete_snapshot" :: held 1.575s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:55 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c5f562a7-c4c9-412c-a6c4-436bdae25492 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-00fdd1e1-367e-4575-97ca-2b2df9b5baf0" released by "delete_snapshot" :: held 1.626s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:55 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:UPDATE=213,cinder:SELECT=169,cinder:DELETE=18,cinder:INSERT=51 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:21:55 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-c5f562a7-c4c9-412c-a6c4-436bdae25492 tempest-ProjectMemberTests-1299516133 None] Created reservations ['7f45556c-3423-4828-bbc4-1186a4340aa0', '34b3546f-7125-4b48-b45d-90eaa8f9e417', '117031e2-fc0d-4822-94ab-ae92ae1712d0', '6ed00f38-4399-485e-9b69-4f25f84577fc'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:55 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-c5f562a7-c4c9-412c-a6c4-436bdae25492 tempest-ProjectMemberTests-1299516133 None] Delete snapshot completed successfully. Sep 05 05:21:55 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-c5f562a7-c4c9-412c-a6c4-436bdae25492 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-c3b9b237-339a-45d3-9562-ec44e1c459ce-delete_snapshot" released by "delete_snapshot" :: held 1.785s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b180e792-4af2-4ae2-ac6b-27139888c409 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-00fdd1e1-367e-4575-97ca-2b2df9b5baf0-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b180e792-4af2-4ae2-ac6b-27139888c409 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-00fdd1e1-367e-4575-97ca-2b2df9b5baf0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:56 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=174,cinder:INSERT=65,cinder:UPDATE=233,cinder:DELETE=20 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:21:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b180e792-4af2-4ae2-ac6b-27139888c409 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-00fdd1e1-367e-4575-97ca-2b2df9b5baf0" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b180e792-4af2-4ae2-ac6b-27139888c409 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-00fdd1e1-367e-4575-97ca-2b2df9b5baf0" acquired by "delete_volume" :: waited 0.015s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:56 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[927ce827-fb64-4618-810e-a1668321e25f]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b180e792-4af2-4ae2-ac6b-27139888c409 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:56 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0 Sep 05 05:21:56 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-853f5f9c-c68b-4a01-875a-ac8bb9e3038b tempest-ProjectReaderTests-1498354998 None] Acquiring lock "cinder-6de2cad6-99bc-431e-8436-6a8cbba65d23-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-853f5f9c-c68b-4a01-875a-ac8bb9e3038b tempest-ProjectReaderTests-1498354998 None] Lock "cinder-6de2cad6-99bc-431e-8436-6a8cbba65d23-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-853f5f9c-c68b-4a01-875a-ac8bb9e3038b tempest-ProjectReaderTests-1498354998 None] Acquiring lock "cinder-quobyte-6de2cad6-99bc-431e-8436-6a8cbba65d23" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:21:56 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-853f5f9c-c68b-4a01-875a-ac8bb9e3038b tempest-ProjectReaderTests-1498354998 None] Lock "cinder-quobyte-6de2cad6-99bc-431e-8436-6a8cbba65d23" acquired by "delete_volume" :: waited 0.019s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:21:56 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c706d431-f83b-4f51-b809-12f4755ceb60]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-853f5f9c-c68b-4a01-875a-ac8bb9e3038b tempest-ProjectReaderTests-1498354998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6de2cad6-99bc-431e-8436-6a8cbba65d23 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:56 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b180e792-4af2-4ae2-ac6b-27139888c409 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0" returned: 0 in 0.383s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b180e792-4af2-4ae2-ac6b-27139888c409 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:56 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0 Sep 05 05:21:56 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:56 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6de2cad6-99bc-431e-8436-6a8cbba65d23 Sep 05 05:21:56 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:56 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:56 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b180e792-4af2-4ae2-ac6b-27139888c409 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-00fdd1e1-367e-4575-97ca-2b2df9b5baf0" returned: 0 in 0.242s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b180e792-4af2-4ae2-ac6b-27139888c409 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-00fdd1e1-367e-4575-97ca-2b2df9b5baf0" released by "delete_volume" :: held 0.685s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:57 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-853f5f9c-c68b-4a01-875a-ac8bb9e3038b tempest-ProjectReaderTests-1498354998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6de2cad6-99bc-431e-8436-6a8cbba65d23" returned: 0 in 0.361s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-853f5f9c-c68b-4a01-875a-ac8bb9e3038b tempest-ProjectReaderTests-1498354998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6de2cad6-99bc-431e-8436-6a8cbba65d23 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:57 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6de2cad6-99bc-431e-8436-6a8cbba65d23 Sep 05 05:21:57 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-b180e792-4af2-4ae2-ac6b-27139888c409 tempest-ProjectMemberTests-1299516133 None] Created reservations ['9e006946-b234-4682-84b8-6b987e74e21d', '7f091e42-aac3-4e37-b9fd-3ba7790eb5c0', '6373183b-2fdd-4e46-9b34-77bcfd82d848', 'ffa5393d-b2f1-46dd-ac7b-2e397edfbe06'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b180e792-4af2-4ae2-ac6b-27139888c409 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b180e792-4af2-4ae2-ac6b-27139888c409 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b180e792-4af2-4ae2-ac6b-27139888c409 tempest-ProjectMemberTests-1299516133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b180e792-4af2-4ae2-ac6b-27139888c409 tempest-ProjectMemberTests-1299516133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b180e792-4af2-4ae2-ac6b-27139888c409 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b180e792-4af2-4ae2-ac6b-27139888c409 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:57 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:21:57 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:57 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-853f5f9c-c68b-4a01-875a-ac8bb9e3038b tempest-ProjectReaderTests-1498354998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-6de2cad6-99bc-431e-8436-6a8cbba65d23" returned: 0 in 0.261s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-853f5f9c-c68b-4a01-875a-ac8bb9e3038b tempest-ProjectReaderTests-1498354998 None] Lock "cinder-quobyte-6de2cad6-99bc-431e-8436-6a8cbba65d23" released by "delete_volume" :: held 0.660s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-853f5f9c-c68b-4a01-875a-ac8bb9e3038b tempest-ProjectReaderTests-1498354998 None] Created reservations ['5266044e-540b-4752-94b1-6868a4b156b8', '4111fadb-e44b-46f0-a919-0b7395dca1b3', 'ddedcc57-c4f5-466b-a813-66de5ad5c4b5', '2f92917a-d74c-4967-a3a6-bbfc0e40ce57'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:21:57 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b180e792-4af2-4ae2-ac6b-27139888c409 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.255s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b180e792-4af2-4ae2-ac6b-27139888c409 tempest-ProjectMemberTests-1299516133 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:21:57 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-b180e792-4af2-4ae2-ac6b-27139888c409 tempest-ProjectMemberTests-1299516133 None] Deleted volume successfully. Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-853f5f9c-c68b-4a01-875a-ac8bb9e3038b tempest-ProjectReaderTests-1498354998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-853f5f9c-c68b-4a01-875a-ac8bb9e3038b tempest-ProjectReaderTests-1498354998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-853f5f9c-c68b-4a01-875a-ac8bb9e3038b tempest-ProjectReaderTests-1498354998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-853f5f9c-c68b-4a01-875a-ac8bb9e3038b tempest-ProjectReaderTests-1498354998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-853f5f9c-c68b-4a01-875a-ac8bb9e3038b tempest-ProjectReaderTests-1498354998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-853f5f9c-c68b-4a01-875a-ac8bb9e3038b tempest-ProjectReaderTests-1498354998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-b180e792-4af2-4ae2-ac6b-27139888c409 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-00fdd1e1-367e-4575-97ca-2b2df9b5baf0-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:57 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:21:57 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:57 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-853f5f9c-c68b-4a01-875a-ac8bb9e3038b tempest-ProjectReaderTests-1498354998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.259s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-853f5f9c-c68b-4a01-875a-ac8bb9e3038b tempest-ProjectReaderTests-1498354998 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:21:57 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-853f5f9c-c68b-4a01-875a-ac8bb9e3038b tempest-ProjectReaderTests-1498354998 None] Deleted volume successfully. Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-853f5f9c-c68b-4a01-875a-ac8bb9e3038b tempest-ProjectReaderTests-1498354998 None] Lock "cinder-6de2cad6-99bc-431e-8436-6a8cbba65d23-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Flow 'volume_create_manager' (03e191bc-f938-4f77-b2ca-cee8d7ac116e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:57 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe61a6c-d82d-4df9-a00b-2cd56cc7cba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe61a6c-d82d-4df9-a00b-2cd56cc7cba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1430216278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3526217-5f32-4e6a-becc-e86753cc3b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad580cb1010b4899b3d6f4071f9a30c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:58Z,use_quota=True,user_id='777649d126094987b71ca3b21cd760a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcade041-045a-47f9-9044-f52e39fd36eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcade041-045a-47f9-9044-f52e39fd36eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21bf0566-19c8-42bc-89c8-88bc84753f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21bf0566-19c8-42bc-89c8-88bc84753f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3526217-5f32-4e6a-becc-e86753cc3b64', 'volume_name': 'volume-e3526217-5f32-4e6a-becc-e86753cc3b64', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9bb0d7c-254d-4c1f-b00d-d99a850f061f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9bb0d7c-254d-4c1f-b00d-d99a850f061f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed4c468-c823-4422-b093-865eff0e2011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:58 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Volume e3526217-5f32-4e6a-becc-e86753cc3b64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3526217-5f32-4e6a-becc-e86753cc3b64', 'volume_size': 1} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1430216278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3526217-5f32-4e6a-becc-e86753cc3b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad580cb1010b4899b3d6f4071f9a30c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:21:58Z,use_quota=True,user_id='777649d126094987b71ca3b21cd760a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Creating volume e3526217-5f32-4e6a-becc-e86753cc3b64 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:21:58 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:58 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64 1073741824 Sep 05 05:21:58 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:58 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64 1073741824" returned: 0 in 0.431s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:58 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64 Sep 05 05:21:58 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:58 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64" returned: 0 in 0.271s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed4c468-c823-4422-b093-865eff0e2011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3526217-5f32-4e6a-becc-e86753cc3b64', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ae3241-8af6-4b85-8c89-f5b51ff56ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:21:58 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Volume volume-e3526217-5f32-4e6a-becc-e86753cc3b64 (e3526217-5f32-4e6a-becc-e86753cc3b64): created successfully Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ae3241-8af6-4b85-8c89-f5b51ff56ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:21:58 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Flow 'volume_create_manager' (03e191bc-f938-4f77-b2ca-cee8d7ac116e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:21:58 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-2ef54e25-5776-4c58-9492-168f10301df2 tempest-ProjectMemberTests-1299516133 None] Created volume successfully. Sep 05 05:21:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-afb2ea5f-466e-40e5-b0e6-2d74d48212cb tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:21:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-afb2ea5f-466e-40e5-b0e6-2d74d48212cb tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:21:59 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-afb2ea5f-466e-40e5-b0e6-2d74d48212cb tempest-ProjectMemberTests-1299516133 None] Creating offline snapshot 15bfd26b-6e57-4b2a-9217-790315830331 of volume e3526217-5f32-4e6a-becc-e86753cc3b64 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:21:59 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[45095638-9bb6-4cb6-9580-77f91fb51ec5]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:21:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-afb2ea5f-466e-40e5-b0e6-2d74d48212cb tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:59 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64 Sep 05 05:21:59 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:59 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-afb2ea5f-466e-40e5-b0e6-2d74d48212cb tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64" returned: 0 in 0.370s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-afb2ea5f-466e-40e5-b0e6-2d74d48212cb tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.15bfd26b-6e57-4b2a-9217-790315830331 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:59 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.15bfd26b-6e57-4b2a-9217-790315830331 1G Sep 05 05:21:59 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:21:59 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Sep 05 05:21:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-afb2ea5f-466e-40e5-b0e6-2d74d48212cb tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.15bfd26b-6e57-4b2a-9217-790315830331 1G" returned: 0 in 0.373s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:21:59 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-afb2ea5f-466e-40e5-b0e6-2d74d48212cb tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3526217-5f32-4e6a-becc-e86753cc3b64 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.15bfd26b-6e57-4b2a-9217-790315830331 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:21:59 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3526217-5f32-4e6a-becc-e86753cc3b64 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.15bfd26b-6e57-4b2a-9217-790315830331 Sep 05 05:21:59 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:00 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-afb2ea5f-466e-40e5-b0e6-2d74d48212cb tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3526217-5f32-4e6a-becc-e86753cc3b64 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.15bfd26b-6e57-4b2a-9217-790315830331" returned: 0 in 0.280s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:00 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-afb2ea5f-466e-40e5-b0e6-2d74d48212cb tempest-ProjectMemberTests-1299516133 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.15bfd26b-6e57-4b2a-9217-790315830331 is being set with open permissions: ugo+rw Sep 05 05:22:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-afb2ea5f-466e-40e5-b0e6-2d74d48212cb tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.15bfd26b-6e57-4b2a-9217-790315830331 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:00 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.15bfd26b-6e57-4b2a-9217-790315830331 Sep 05 05:22:00 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:00 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-afb2ea5f-466e-40e5-b0e6-2d74d48212cb tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.15bfd26b-6e57-4b2a-9217-790315830331" returned: 0 in 0.245s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-afb2ea5f-466e-40e5-b0e6-2d74d48212cb tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:00 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.info Sep 05 05:22:00 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:00 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-afb2ea5f-466e-40e5-b0e6-2d74d48212cb tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.info" returned: 0 in 0.248s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:00 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-afb2ea5f-466e-40e5-b0e6-2d74d48212cb tempest-ProjectMemberTests-1299516133 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.info is being set with open permissions: ugo+rw Sep 05 05:22:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-afb2ea5f-466e-40e5-b0e6-2d74d48212cb tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:00 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.info Sep 05 05:22:00 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:00 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-afb2ea5f-466e-40e5-b0e6-2d74d48212cb tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.info" returned: 0 in 0.240s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:00 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-afb2ea5f-466e-40e5-b0e6-2d74d48212cb tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.843s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:22:00 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-afb2ea5f-466e-40e5-b0e6-2d74d48212cb tempest-ProjectMemberTests-1299516133 None] Create snapshot completed successfully Sep 05 05:22:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-bac16452-b0f1-46e2-9b53-b081c176186f tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-15bfd26b-6e57-4b2a-9217-790315830331-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:22:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-bac16452-b0f1-46e2-9b53-b081c176186f tempest-ProjectMemberTests-1299516133 None] Lock "cinder-15bfd26b-6e57-4b2a-9217-790315830331-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:22:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-bac16452-b0f1-46e2-9b53-b081c176186f tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-e3526217-5f32-4e6a-becc-e86753cc3b64" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:22:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-bac16452-b0f1-46e2-9b53-b081c176186f tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-e3526217-5f32-4e6a-becc-e86753cc3b64" acquired by "delete_snapshot" :: waited 0.014s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:22:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-bac16452-b0f1-46e2-9b53-b081c176186f tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-15bfd26b-6e57-4b2a-9217-790315830331" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:22:01 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-bac16452-b0f1-46e2-9b53-b081c176186f tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-15bfd26b-6e57-4b2a-9217-790315830331" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:22:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-bac16452-b0f1-46e2-9b53-b081c176186f tempest-ProjectMemberTests-1299516133 None] Deleting offline snapshot 15bfd26b-6e57-4b2a-9217-790315830331 of volume e3526217-5f32-4e6a-becc-e86753cc3b64 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:22:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-bac16452-b0f1-46e2-9b53-b081c176186f tempest-ProjectMemberTests-1299516133 None] snapshot_file for this snap is: volume-e3526217-5f32-4e6a-becc-e86753cc3b64.15bfd26b-6e57-4b2a-9217-790315830331 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:22:01 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6edb321-f9dc-4f78-b109-6ab973e8fe8d]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:22:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bac16452-b0f1-46e2-9b53-b081c176186f tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.15bfd26b-6e57-4b2a-9217-790315830331 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:01 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.15bfd26b-6e57-4b2a-9217-790315830331 Sep 05 05:22:01 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:01 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bac16452-b0f1-46e2-9b53-b081c176186f tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.15bfd26b-6e57-4b2a-9217-790315830331" returned: 0 in 0.355s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:01 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-bac16452-b0f1-46e2-9b53-b081c176186f tempest-ProjectMemberTests-1299516133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3526217-5f32-4e6a-becc-e86753cc3b64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:22:01 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[97189abf-a715-4f78-9f65-daabb360de63]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:22:01 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bac16452-b0f1-46e2-9b53-b081c176186f tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:01 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64 Sep 05 05:22:01 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:02 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bac16452-b0f1-46e2-9b53-b081c176186f tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64" returned: 0 in 0.366s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bac16452-b0f1-46e2-9b53-b081c176186f tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.15bfd26b-6e57-4b2a-9217-790315830331 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:02 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.15bfd26b-6e57-4b2a-9217-790315830331 Sep 05 05:22:02 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:02 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bac16452-b0f1-46e2-9b53-b081c176186f tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.15bfd26b-6e57-4b2a-9217-790315830331" returned: 0 in 0.344s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bac16452-b0f1-46e2-9b53-b081c176186f tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.15bfd26b-6e57-4b2a-9217-790315830331 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:02 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.15bfd26b-6e57-4b2a-9217-790315830331 Sep 05 05:22:02 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:02 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:02 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bac16452-b0f1-46e2-9b53-b081c176186f tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64.15bfd26b-6e57-4b2a-9217-790315830331" returned: 0 in 0.239s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:02 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-bac16452-b0f1-46e2-9b53-b081c176186f tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-15bfd26b-6e57-4b2a-9217-790315830331" released by "_delete_snapshot" :: held 1.384s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:22:02 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-bac16452-b0f1-46e2-9b53-b081c176186f tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-e3526217-5f32-4e6a-becc-e86753cc3b64" released by "delete_snapshot" :: held 1.404s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:22:02 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-bac16452-b0f1-46e2-9b53-b081c176186f tempest-ProjectMemberTests-1299516133 None] Created reservations ['5be605ea-d2e0-4978-98df-64716330f2ec', '996c9918-dae5-4e98-a6b5-961f6a4a7488', 'eebefefe-6756-4064-b8ae-b2fa0048a85b', '3d073b37-d268-4247-ad64-f041b4fcf480'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:22:02 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-bac16452-b0f1-46e2-9b53-b081c176186f tempest-ProjectMemberTests-1299516133 None] Delete snapshot completed successfully. Sep 05 05:22:02 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-bac16452-b0f1-46e2-9b53-b081c176186f tempest-ProjectMemberTests-1299516133 None] Lock "cinder-15bfd26b-6e57-4b2a-9217-790315830331-delete_snapshot" released by "delete_snapshot" :: held 1.527s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:22:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1411ee97-8963-4eb1-90bd-b378fe6616e1 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-e3526217-5f32-4e6a-becc-e86753cc3b64-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:22:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1411ee97-8963-4eb1-90bd-b378fe6616e1 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-e3526217-5f32-4e6a-becc-e86753cc3b64-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:22:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1411ee97-8963-4eb1-90bd-b378fe6616e1 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-e3526217-5f32-4e6a-becc-e86753cc3b64" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:22:03 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1411ee97-8963-4eb1-90bd-b378fe6616e1 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-e3526217-5f32-4e6a-becc-e86753cc3b64" acquired by "delete_volume" :: waited 0.015s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:22:03 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0250109-6f60-45ee-b990-97a6d6b84d19]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:22:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1411ee97-8963-4eb1-90bd-b378fe6616e1 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:03 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64 Sep 05 05:22:03 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:03 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1411ee97-8963-4eb1-90bd-b378fe6616e1 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64" returned: 0 in 0.343s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:03 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1411ee97-8963-4eb1-90bd-b378fe6616e1 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:03 devstack sudo[108307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64 Sep 05 05:22:03 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:04 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1411ee97-8963-4eb1-90bd-b378fe6616e1 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-e3526217-5f32-4e6a-becc-e86753cc3b64" returned: 0 in 0.241s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1411ee97-8963-4eb1-90bd-b378fe6616e1 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-e3526217-5f32-4e6a-becc-e86753cc3b64" released by "delete_volume" :: held 0.641s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:22:04 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-1411ee97-8963-4eb1-90bd-b378fe6616e1 tempest-ProjectMemberTests-1299516133 None] Created reservations ['28ba2538-7326-426a-b73c-bd0e1e69e0b3', '1f5ca589-6aaf-456e-ba53-f125fadf91c9', '8ffca08b-8415-455e-95ed-525cf83a8c89', '518463ca-94af-4b0a-917d-6188d7e45f1c'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:22:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1411ee97-8963-4eb1-90bd-b378fe6616e1 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:22:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1411ee97-8963-4eb1-90bd-b378fe6616e1 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:22:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-1411ee97-8963-4eb1-90bd-b378fe6616e1 tempest-ProjectMemberTests-1299516133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:22:04 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-1411ee97-8963-4eb1-90bd-b378fe6616e1 tempest-ProjectMemberTests-1299516133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:22:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-1411ee97-8963-4eb1-90bd-b378fe6616e1 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:22:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1411ee97-8963-4eb1-90bd-b378fe6616e1 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:04 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:22:04 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:04 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:04 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-1411ee97-8963-4eb1-90bd-b378fe6616e1 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.239s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:04 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-1411ee97-8963-4eb1-90bd-b378fe6616e1 tempest-ProjectMemberTests-1299516133 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:22:04 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-1411ee97-8963-4eb1-90bd-b378fe6616e1 tempest-ProjectMemberTests-1299516133 None] Deleted volume successfully. Sep 05 05:22:04 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-1411ee97-8963-4eb1-90bd-b378fe6616e1 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-e3526217-5f32-4e6a-becc-e86753cc3b64-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:22:04 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Flow 'volume_create_manager' (9ddd1bb2-4e23-4e48-b27d-aae20ad49d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65cc9162-e1a8-47f4-9471-bfbcbbd58fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65cc9162-e1a8-47f4-9471-bfbcbbd58fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-810762363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad580cb1010b4899b3d6f4071f9a30c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:22:05Z,use_quota=True,user_id='777649d126094987b71ca3b21cd760a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7cf101b-0b97-496b-8cec-326bf562561e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7cf101b-0b97-496b-8cec-326bf562561e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c9ba7c-3bca-477e-9681-e396ba73c0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c9ba7c-3bca-477e-9681-e396ba73c0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f', 'volume_name': 'volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa925d1-48fb-4d24-9f9a-78f6fe6e89af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa925d1-48fb-4d24-9f9a-78f6fe6e89af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e3d76c-703b-4102-9f05-04bf5b7ec0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:22:05 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Volume 7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f', 'volume_size': 1} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-810762363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad580cb1010b4899b3d6f4071f9a30c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:22:05Z,use_quota=True,user_id='777649d126094987b71ca3b21cd760a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Creating volume 7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:22:05 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:05 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f 1073741824 Sep 05 05:22:05 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:05 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f 1073741824" returned: 0 in 0.393s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:05 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f Sep 05 05:22:05 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:05 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f" returned: 0 in 0.247s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e3d76c-703b-4102-9f05-04bf5b7ec0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb859d15-e246-4cad-a1cf-722f06e00335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:22:05 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Volume volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f (7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f): created successfully Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb859d15-e246-4cad-a1cf-722f06e00335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:22:05 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Flow 'volume_create_manager' (9ddd1bb2-4e23-4e48-b27d-aae20ad49d73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:22:05 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-8f6f8ec7-9363-415c-9f1a-26b9ad426f69 tempest-ProjectMemberTests-1299516133 None] Created volume successfully. Sep 05 05:22:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-bf7a9639-1f6d-4cda-9093-0cfcdfa45a19 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:22:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-bf7a9639-1f6d-4cda-9093-0cfcdfa45a19 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:22:06 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-bf7a9639-1f6d-4cda-9093-0cfcdfa45a19 tempest-ProjectMemberTests-1299516133 None] Creating offline snapshot 5041d903-0dc1-42b7-951b-a3627feaaf94 of volume 7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:22:06 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4c28c8-9e5d-4e2e-b2d4-1d0bedf3bc68]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:22:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bf7a9639-1f6d-4cda-9093-0cfcdfa45a19 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:06 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f Sep 05 05:22:06 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:06 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bf7a9639-1f6d-4cda-9093-0cfcdfa45a19 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f" returned: 0 in 0.345s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bf7a9639-1f6d-4cda-9093-0cfcdfa45a19 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.5041d903-0dc1-42b7-951b-a3627feaaf94 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:06 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.5041d903-0dc1-42b7-951b-a3627feaaf94 1G Sep 05 05:22:06 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:06 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bf7a9639-1f6d-4cda-9093-0cfcdfa45a19 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.5041d903-0dc1-42b7-951b-a3627feaaf94 1G" returned: 0 in 0.377s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:06 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bf7a9639-1f6d-4cda-9093-0cfcdfa45a19 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.5041d903-0dc1-42b7-951b-a3627feaaf94 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:06 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.5041d903-0dc1-42b7-951b-a3627feaaf94 Sep 05 05:22:06 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:07 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bf7a9639-1f6d-4cda-9093-0cfcdfa45a19 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.5041d903-0dc1-42b7-951b-a3627feaaf94" returned: 0 in 0.289s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:07 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-bf7a9639-1f6d-4cda-9093-0cfcdfa45a19 tempest-ProjectMemberTests-1299516133 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.5041d903-0dc1-42b7-951b-a3627feaaf94 is being set with open permissions: ugo+rw Sep 05 05:22:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bf7a9639-1f6d-4cda-9093-0cfcdfa45a19 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.5041d903-0dc1-42b7-951b-a3627feaaf94 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:07 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.5041d903-0dc1-42b7-951b-a3627feaaf94 Sep 05 05:22:07 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:07 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bf7a9639-1f6d-4cda-9093-0cfcdfa45a19 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.5041d903-0dc1-42b7-951b-a3627feaaf94" returned: 0 in 0.251s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bf7a9639-1f6d-4cda-9093-0cfcdfa45a19 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:07 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.info Sep 05 05:22:07 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:07 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bf7a9639-1f6d-4cda-9093-0cfcdfa45a19 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.info" returned: 0 in 0.240s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:07 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-bf7a9639-1f6d-4cda-9093-0cfcdfa45a19 tempest-ProjectMemberTests-1299516133 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.info is being set with open permissions: ugo+rw Sep 05 05:22:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bf7a9639-1f6d-4cda-9093-0cfcdfa45a19 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:07 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.info Sep 05 05:22:07 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:07 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-bf7a9639-1f6d-4cda-9093-0cfcdfa45a19 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.info" returned: 0 in 0.233s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:07 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-bf7a9639-1f6d-4cda-9093-0cfcdfa45a19 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.817s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:22:07 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-bf7a9639-1f6d-4cda-9093-0cfcdfa45a19 tempest-ProjectMemberTests-1299516133 None] Create snapshot completed successfully Sep 05 05:22:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7d7c54e2-a774-45c8-a58c-5e5ef188720c tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-5041d903-0dc1-42b7-951b-a3627feaaf94-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:22:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7d7c54e2-a774-45c8-a58c-5e5ef188720c tempest-ProjectMemberTests-1299516133 None] Lock "cinder-5041d903-0dc1-42b7-951b-a3627feaaf94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:22:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7d7c54e2-a774-45c8-a58c-5e5ef188720c tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:22:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7d7c54e2-a774-45c8-a58c-5e5ef188720c tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:22:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7d7c54e2-a774-45c8-a58c-5e5ef188720c tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-5041d903-0dc1-42b7-951b-a3627feaaf94" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:22:08 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7d7c54e2-a774-45c8-a58c-5e5ef188720c tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-5041d903-0dc1-42b7-951b-a3627feaaf94" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:22:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-7d7c54e2-a774-45c8-a58c-5e5ef188720c tempest-ProjectMemberTests-1299516133 None] Deleting offline snapshot 5041d903-0dc1-42b7-951b-a3627feaaf94 of volume 7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:22:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-7d7c54e2-a774-45c8-a58c-5e5ef188720c tempest-ProjectMemberTests-1299516133 None] snapshot_file for this snap is: volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.5041d903-0dc1-42b7-951b-a3627feaaf94 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:22:08 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4045f7f5-6537-4b66-844d-7a630d4f045b]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:22:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7d7c54e2-a774-45c8-a58c-5e5ef188720c tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.5041d903-0dc1-42b7-951b-a3627feaaf94 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:08 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.5041d903-0dc1-42b7-951b-a3627feaaf94 Sep 05 05:22:08 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:08 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7d7c54e2-a774-45c8-a58c-5e5ef188720c tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.5041d903-0dc1-42b7-951b-a3627feaaf94" returned: 0 in 0.347s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:08 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-7d7c54e2-a774-45c8-a58c-5e5ef188720c tempest-ProjectMemberTests-1299516133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:22:08 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3425a07-5b9b-4a7b-b76e-95f752d1e604]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:22:08 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7d7c54e2-a774-45c8-a58c-5e5ef188720c tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:08 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f Sep 05 05:22:08 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:09 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7d7c54e2-a774-45c8-a58c-5e5ef188720c tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f" returned: 0 in 0.344s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7d7c54e2-a774-45c8-a58c-5e5ef188720c tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.5041d903-0dc1-42b7-951b-a3627feaaf94 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:09 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.5041d903-0dc1-42b7-951b-a3627feaaf94 Sep 05 05:22:09 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:09 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7d7c54e2-a774-45c8-a58c-5e5ef188720c tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.5041d903-0dc1-42b7-951b-a3627feaaf94" returned: 0 in 0.332s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7d7c54e2-a774-45c8-a58c-5e5ef188720c tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.5041d903-0dc1-42b7-951b-a3627feaaf94 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:09 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.5041d903-0dc1-42b7-951b-a3627feaaf94 Sep 05 05:22:09 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:09 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:09 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-7d7c54e2-a774-45c8-a58c-5e5ef188720c tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f.5041d903-0dc1-42b7-951b-a3627feaaf94" returned: 0 in 0.238s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7d7c54e2-a774-45c8-a58c-5e5ef188720c tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-5041d903-0dc1-42b7-951b-a3627feaaf94" released by "_delete_snapshot" :: held 1.340s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:22:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7d7c54e2-a774-45c8-a58c-5e5ef188720c tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f" released by "delete_snapshot" :: held 1.361s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:22:09 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-7d7c54e2-a774-45c8-a58c-5e5ef188720c tempest-ProjectMemberTests-1299516133 None] Created reservations ['9b650a96-cdc1-4137-b579-b55ba516dd5b', '86d02905-049c-4b98-a4d5-2837ece531db', '89678935-4c09-47b1-975c-0dc4696dc21f', '225d3f00-b0f0-4588-ae62-774672c90c60'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:22:09 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-7d7c54e2-a774-45c8-a58c-5e5ef188720c tempest-ProjectMemberTests-1299516133 None] Delete snapshot completed successfully. Sep 05 05:22:09 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-7d7c54e2-a774-45c8-a58c-5e5ef188720c tempest-ProjectMemberTests-1299516133 None] Lock "cinder-5041d903-0dc1-42b7-951b-a3627feaaf94-delete_snapshot" released by "delete_snapshot" :: held 1.486s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:22:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fa2ff3a8-a4d9-4f14-89f6-7a1bdd23b5ee tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:22:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fa2ff3a8-a4d9-4f14-89f6-7a1bdd23b5ee tempest-ProjectMemberTests-1299516133 None] Lock "cinder-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:22:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fa2ff3a8-a4d9-4f14-89f6-7a1bdd23b5ee tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:22:10 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fa2ff3a8-a4d9-4f14-89f6-7a1bdd23b5ee tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f" acquired by "delete_volume" :: waited 0.014s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:22:10 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[321405b2-6190-4a87-9ca3-1ae93133b191]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:22:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa2ff3a8-a4d9-4f14-89f6-7a1bdd23b5ee tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:10 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f Sep 05 05:22:10 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:10 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa2ff3a8-a4d9-4f14-89f6-7a1bdd23b5ee tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f" returned: 0 in 0.354s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:10 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa2ff3a8-a4d9-4f14-89f6-7a1bdd23b5ee tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:10 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f Sep 05 05:22:10 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:11 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa2ff3a8-a4d9-4f14-89f6-7a1bdd23b5ee tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f" returned: 0 in 0.245s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fa2ff3a8-a4d9-4f14-89f6-7a1bdd23b5ee tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f" released by "delete_volume" :: held 0.649s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:22:11 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-fa2ff3a8-a4d9-4f14-89f6-7a1bdd23b5ee tempest-ProjectMemberTests-1299516133 None] Created reservations ['7d500de7-d6a7-4575-ad42-81342468f4ec', '5bbf3bd6-4d3c-449f-80ba-b81a5ea8288a', '5abcbb3e-73c6-462b-af50-bbbdb0afeee5', 'c90119c2-19c3-4483-8ed7-3d8c60e60c95'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:22:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fa2ff3a8-a4d9-4f14-89f6-7a1bdd23b5ee tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:22:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fa2ff3a8-a4d9-4f14-89f6-7a1bdd23b5ee tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:22:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-fa2ff3a8-a4d9-4f14-89f6-7a1bdd23b5ee tempest-ProjectMemberTests-1299516133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:22:11 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-fa2ff3a8-a4d9-4f14-89f6-7a1bdd23b5ee tempest-ProjectMemberTests-1299516133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:22:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-fa2ff3a8-a4d9-4f14-89f6-7a1bdd23b5ee tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:22:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa2ff3a8-a4d9-4f14-89f6-7a1bdd23b5ee tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:11 devstack sudo[108376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:22:11 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:11 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:11 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-fa2ff3a8-a4d9-4f14-89f6-7a1bdd23b5ee tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.238s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:11 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-fa2ff3a8-a4d9-4f14-89f6-7a1bdd23b5ee tempest-ProjectMemberTests-1299516133 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:22:11 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-fa2ff3a8-a4d9-4f14-89f6-7a1bdd23b5ee tempest-ProjectMemberTests-1299516133 None] Deleted volume successfully. Sep 05 05:22:11 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-fa2ff3a8-a4d9-4f14-89f6-7a1bdd23b5ee tempest-ProjectMemberTests-1299516133 None] Lock "cinder-7ec527fb-f0e9-4ad7-9b34-1c5c4e6fda4f-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:22:11 devstack cinder-volume[89331]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Flow 'volume_create_manager' (ab929e0c-7e01-4b74-a293-07a5e51b9fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777a3d90-7078-4e9b-a3cb-5e73c03e2a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777a3d90-7078-4e9b-a3cb-5e73c03e2a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-98887596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=219cf588-cb87-41f6-be9b-b56a093950f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad580cb1010b4899b3d6f4071f9a30c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:22:12Z,use_quota=True,user_id='777649d126094987b71ca3b21cd760a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc6d787-78b2-4452-8fa8-5c02504f3f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc6d787-78b2-4452-8fa8-5c02504f3f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa86ab7b-6fb8-4a33-8bbb-e47abc204aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa86ab7b-6fb8-4a33-8bbb-e47abc204aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '219cf588-cb87-41f6-be9b-b56a093950f5', 'volume_name': 'volume-219cf588-cb87-41f6-be9b-b56a093950f5', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6488459-756a-4e2a-ac7a-9a8338aac108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6488459-756a-4e2a-ac7a-9a8338aac108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d6c01a-c75a-4625-bdcf-b240f56e65ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:22:12 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Volume 219cf588-cb87-41f6-be9b-b56a093950f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-219cf588-cb87-41f6-be9b-b56a093950f5', 'volume_size': 1} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-98887596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=219cf588-cb87-41f6-be9b-b56a093950f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad580cb1010b4899b3d6f4071f9a30c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:22:12Z,use_quota=True,user_id='777649d126094987b71ca3b21cd760a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c51b41-f1ea-4226-84fc-6421ffff3f36),volume_type_id=05c51b41-f1ea-4226-84fc-6421ffff3f36)}" {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Creating volume 219cf588-cb87-41f6-be9b-b56a093950f5 {{(pid=89331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Selected osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 as target Quobyte volume. {{(pid=89331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:22:12 devstack cinder-volume[89331]: INFO cinder.volume.drivers.remotefs [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] casted to osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136 Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5 1073741824 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:12 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5 1073741824 Sep 05 05:22:12 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:12 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5 1073741824" returned: 0 in 0.396s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:12 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5 Sep 05 05:22:12 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:12 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5" returned: 0 in 0.235s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'} {{(pid=89331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d6c01a-c75a-4625-bdcf-b240f56e65ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-219cf588-cb87-41f6-be9b-b56a093950f5', 'volume_size': 1}' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3f39ea-108b-41c3-aee4-8b49f5ee24c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:22:12 devstack cinder-volume[89331]: INFO cinder.volume.flows.manager.create_volume [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Volume volume-219cf588-cb87-41f6-be9b-b56a093950f5 (219cf588-cb87-41f6-be9b-b56a093950f5): created successfully Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3f39ea-108b-41c3-aee4-8b49f5ee24c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:22:12 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Flow 'volume_create_manager' (ab929e0c-7e01-4b74-a293-07a5e51b9fb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:22:12 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-3e3d78ad-aa3d-4c9d-ba38-da3656c4cf1a tempest-ProjectMemberTests-1299516133 None] Created volume successfully. Sep 05 05:22:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-61d486bf-efc8-4dbf-b268-73de644059a3 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:22:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-61d486bf-efc8-4dbf-b268-73de644059a3 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:22:13 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-61d486bf-efc8-4dbf-b268-73de644059a3 tempest-ProjectMemberTests-1299516133 None] Creating offline snapshot c4654400-b40a-4919-a20a-3e91a372a9fe of volume 219cf588-cb87-41f6-be9b-b56a093950f5 {{(pid=89331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:22:13 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f2c9c0-ec81-44f2-b048-dd65fc047453]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:22:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-61d486bf-efc8-4dbf-b268-73de644059a3 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:13 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5 Sep 05 05:22:13 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:13 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-61d486bf-efc8-4dbf-b268-73de644059a3 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5" returned: 0 in 0.343s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-61d486bf-efc8-4dbf-b268-73de644059a3 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.c4654400-b40a-4919-a20a-3e91a372a9fe 1G {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:13 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.c4654400-b40a-4919-a20a-3e91a372a9fe 1G Sep 05 05:22:13 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:13 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-61d486bf-efc8-4dbf-b268-73de644059a3 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.c4654400-b40a-4919-a20a-3e91a372a9fe 1G" returned: 0 in 0.380s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:13 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-61d486bf-efc8-4dbf-b268-73de644059a3 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-219cf588-cb87-41f6-be9b-b56a093950f5 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.c4654400-b40a-4919-a20a-3e91a372a9fe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:13 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-219cf588-cb87-41f6-be9b-b56a093950f5 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.c4654400-b40a-4919-a20a-3e91a372a9fe Sep 05 05:22:13 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:14 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-61d486bf-efc8-4dbf-b268-73de644059a3 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-219cf588-cb87-41f6-be9b-b56a093950f5 -F qcow2 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.c4654400-b40a-4919-a20a-3e91a372a9fe" returned: 0 in 0.295s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:14 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-61d486bf-efc8-4dbf-b268-73de644059a3 tempest-ProjectMemberTests-1299516133 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.c4654400-b40a-4919-a20a-3e91a372a9fe is being set with open permissions: ugo+rw Sep 05 05:22:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-61d486bf-efc8-4dbf-b268-73de644059a3 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.c4654400-b40a-4919-a20a-3e91a372a9fe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:14 devstack sudo[108406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.c4654400-b40a-4919-a20a-3e91a372a9fe Sep 05 05:22:14 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:14 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-61d486bf-efc8-4dbf-b268-73de644059a3 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.c4654400-b40a-4919-a20a-3e91a372a9fe" returned: 0 in 0.237s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-61d486bf-efc8-4dbf-b268-73de644059a3 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:14 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.info Sep 05 05:22:14 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:14 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-61d486bf-efc8-4dbf-b268-73de644059a3 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.info" returned: 0 in 0.247s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:14 devstack cinder-volume[89331]: WARNING cinder.volume.drivers.remotefs [None req-61d486bf-efc8-4dbf-b268-73de644059a3 tempest-ProjectMemberTests-1299516133 None] /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.info is being set with open permissions: ugo+rw Sep 05 05:22:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-61d486bf-efc8-4dbf-b268-73de644059a3 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.info {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:14 devstack sudo[108412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.info Sep 05 05:22:14 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:14 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-61d486bf-efc8-4dbf-b268-73de644059a3 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.info" returned: 0 in 0.232s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:14 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-61d486bf-efc8-4dbf-b268-73de644059a3 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.814s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:22:14 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-61d486bf-efc8-4dbf-b268-73de644059a3 tempest-ProjectMemberTests-1299516133 None] Create snapshot completed successfully Sep 05 05:22:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f2863ea8-4b64-4ae9-99bf-94be3c86a1a9 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-c4654400-b40a-4919-a20a-3e91a372a9fe-delete_snapshot" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:22:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f2863ea8-4b64-4ae9-99bf-94be3c86a1a9 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-c4654400-b40a-4919-a20a-3e91a372a9fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:22:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f2863ea8-4b64-4ae9-99bf-94be3c86a1a9 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-219cf588-cb87-41f6-be9b-b56a093950f5" by "delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:22:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f2863ea8-4b64-4ae9-99bf-94be3c86a1a9 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-219cf588-cb87-41f6-be9b-b56a093950f5" acquired by "delete_snapshot" :: waited 0.013s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:22:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f2863ea8-4b64-4ae9-99bf-94be3c86a1a9 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-c4654400-b40a-4919-a20a-3e91a372a9fe" by "_delete_snapshot" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:22:15 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f2863ea8-4b64-4ae9-99bf-94be3c86a1a9 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-c4654400-b40a-4919-a20a-3e91a372a9fe" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:22:15 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-f2863ea8-4b64-4ae9-99bf-94be3c86a1a9 tempest-ProjectMemberTests-1299516133 None] Deleting offline snapshot c4654400-b40a-4919-a20a-3e91a372a9fe of volume 219cf588-cb87-41f6-be9b-b56a093950f5 {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:22:15 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-f2863ea8-4b64-4ae9-99bf-94be3c86a1a9 tempest-ProjectMemberTests-1299516133 None] snapshot_file for this snap is: volume-219cf588-cb87-41f6-be9b-b56a093950f5.c4654400-b40a-4919-a20a-3e91a372a9fe {{(pid=89331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:22:15 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67dd937-4b57-4172-b36a-8b1840a062d1]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:22:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f2863ea8-4b64-4ae9-99bf-94be3c86a1a9 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.c4654400-b40a-4919-a20a-3e91a372a9fe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:15 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.c4654400-b40a-4919-a20a-3e91a372a9fe Sep 05 05:22:15 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:15 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f2863ea8-4b64-4ae9-99bf-94be3c86a1a9 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.c4654400-b40a-4919-a20a-3e91a372a9fe" returned: 0 in 0.353s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:15 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.remotefs [None req-f2863ea8-4b64-4ae9-99bf-94be3c86a1a9 tempest-ProjectMemberTests-1299516133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-219cf588-cb87-41f6-be9b-b56a093950f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:22:15 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b063717c-fa77-4961-8b86-efbd51f6b66a]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:22:15 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f2863ea8-4b64-4ae9-99bf-94be3c86a1a9 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:15 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5 Sep 05 05:22:15 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:16 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f2863ea8-4b64-4ae9-99bf-94be3c86a1a9 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5" returned: 0 in 0.358s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f2863ea8-4b64-4ae9-99bf-94be3c86a1a9 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.c4654400-b40a-4919-a20a-3e91a372a9fe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:16 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.c4654400-b40a-4919-a20a-3e91a372a9fe Sep 05 05:22:16 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:16 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f2863ea8-4b64-4ae9-99bf-94be3c86a1a9 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.c4654400-b40a-4919-a20a-3e91a372a9fe" returned: 0 in 0.317s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f2863ea8-4b64-4ae9-99bf-94be3c86a1a9 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.c4654400-b40a-4919-a20a-3e91a372a9fe {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:16 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.c4654400-b40a-4919-a20a-3e91a372a9fe Sep 05 05:22:16 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:16 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:16 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-f2863ea8-4b64-4ae9-99bf-94be3c86a1a9 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5.c4654400-b40a-4919-a20a-3e91a372a9fe" returned: 0 in 0.236s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f2863ea8-4b64-4ae9-99bf-94be3c86a1a9 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-c4654400-b40a-4919-a20a-3e91a372a9fe" released by "_delete_snapshot" :: held 1.349s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:22:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f2863ea8-4b64-4ae9-99bf-94be3c86a1a9 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-219cf588-cb87-41f6-be9b-b56a093950f5" released by "delete_snapshot" :: held 1.369s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:22:16 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-f2863ea8-4b64-4ae9-99bf-94be3c86a1a9 tempest-ProjectMemberTests-1299516133 None] Created reservations ['36b23614-9ef9-4775-a8a5-8fbc861ad649', '6fec0725-6295-4654-9d63-fba3e4e9131b', '3683ec2d-66d0-429e-b424-30e5887aa4a4', 'b57bd918-d4d3-477f-91af-1a0597e86683'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:22:16 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-f2863ea8-4b64-4ae9-99bf-94be3c86a1a9 tempest-ProjectMemberTests-1299516133 None] Delete snapshot completed successfully. Sep 05 05:22:16 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-f2863ea8-4b64-4ae9-99bf-94be3c86a1a9 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-c4654400-b40a-4919-a20a-3e91a372a9fe-delete_snapshot" released by "delete_snapshot" :: held 1.493s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:22:17 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d06e8ba3-e54e-4284-9f62-153c7990c0e6 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-219cf588-cb87-41f6-be9b-b56a093950f5-delete_volume" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:22:17 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d06e8ba3-e54e-4284-9f62-153c7990c0e6 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-219cf588-cb87-41f6-be9b-b56a093950f5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:22:17 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d06e8ba3-e54e-4284-9f62-153c7990c0e6 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "cinder-quobyte-219cf588-cb87-41f6-be9b-b56a093950f5" by "delete_volume" {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:22:17 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d06e8ba3-e54e-4284-9f62-153c7990c0e6 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-219cf588-cb87-41f6-be9b-b56a093950f5" acquired by "delete_volume" :: waited 0.018s {{(pid=89331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:22:17 devstack cinder-volume[89331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b8e9a3-b19a-40b8-871a-c172eac6ae81]: (4, 'qcow2') {{(pid=90987) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:22:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d06e8ba3-e54e-4284-9f62-153c7990c0e6 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:17 devstack sudo[108435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5 Sep 05 05:22:17 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:17 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d06e8ba3-e54e-4284-9f62-153c7990c0e6 tempest-ProjectMemberTests-1299516133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5" returned: 0 in 0.343s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:17 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d06e8ba3-e54e-4284-9f62-153c7990c0e6 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:18 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5 Sep 05 05:22:18 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:18 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d06e8ba3-e54e-4284-9f62-153c7990c0e6 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9/volume-219cf588-cb87-41f6-be9b-b56a093950f5" returned: 0 in 0.242s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d06e8ba3-e54e-4284-9f62-153c7990c0e6 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-quobyte-219cf588-cb87-41f6-be9b-b56a093950f5" released by "delete_volume" :: held 0.639s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:22:18 devstack cinder-volume[89331]: DEBUG cinder.quota [None req-d06e8ba3-e54e-4284-9f62-153c7990c0e6 tempest-ProjectMemberTests-1299516133 None] Created reservations ['c5912055-952c-4a13-9bbd-ed3a424f8bf5', '1ce819b5-8dfb-4f95-9ccd-e695b577574f', '9d89ebd3-41d5-4e33-8b06-dc9d9b3fa122', 'addf50ad-118f-46c4-b50e-a4b2341560c2'] {{(pid=89331) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:22:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d06e8ba3-e54e-4284-9f62-153c7990c0e6 tempest-ProjectMemberTests-1299516133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:22:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d06e8ba3-e54e-4284-9f62-153c7990c0e6 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:22:18 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d06e8ba3-e54e-4284-9f62-153c7990c0e6 tempest-ProjectMemberTests-1299516133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:22:18 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-d06e8ba3-e54e-4284-9f62-153c7990c0e6 tempest-ProjectMemberTests-1299516133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:22:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-d06e8ba3-e54e-4284-9f62-153c7990c0e6 tempest-ProjectMemberTests-1299516133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:22:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d06e8ba3-e54e-4284-9f62-153c7990c0e6 tempest-ProjectMemberTests-1299516133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:18 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:22:18 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:18 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:18 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-d06e8ba3-e54e-4284-9f62-153c7990c0e6 tempest-ProjectMemberTests-1299516133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.241s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:18 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-d06e8ba3-e54e-4284-9f62-153c7990c0e6 tempest-ProjectMemberTests-1299516133 None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:22:18 devstack cinder-volume[89331]: INFO cinder.volume.manager [None req-d06e8ba3-e54e-4284-9f62-153c7990c0e6 tempest-ProjectMemberTests-1299516133 None] Deleted volume successfully. Sep 05 05:22:18 devstack cinder-volume[89331]: DEBUG cinder.coordination [None req-d06e8ba3-e54e-4284-9f62-153c7990c0e6 tempest-ProjectMemberTests-1299516133 None] Lock "cinder-219cf588-cb87-41f6-be9b-b56a093950f5-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=89331) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:22:28 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=61,cinder:INSERT=24,cinder:UPDATE=69,cinder:DELETE=5 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:22:29 devstack cinder-volume[89331]: DEBUG dbcounter [-] [89331] Writing DB stats cinder:SELECT=44,cinder:INSERT=16,cinder:UPDATE=75,cinder:DELETE=6 {{(pid=89331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:22:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:22:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:22:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:22:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136': None} {{(pid=89331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:22:49 devstack cinder-volume[89331]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a543a9c-4561-452b-a28a-ff3299dc9136'] {{(pid=89331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:22:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.lockutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:22:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:22:49 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9 Sep 05 05:22:49 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:22:49 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Sep 05 05:22:49 devstack cinder-volume[89331]: DEBUG oslo_concurrency.processutils [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9f4acd68a126b159f1fe5a41340a9a9" returned: 0 in 0.247s {{(pid=89331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:22:49 devstack cinder-volume[89331]: DEBUG cinder.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Notifying Schedulers of capabilities ... {{(pid=89331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:22:49 devstack cinder-volume[89331]: DEBUG oslo_service.periodic_task [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] Running periodic task VolumeManager._thread_info {{(pid=89331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:22:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread count: 29 {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 05:22:49 devstack cinder-volume[89331]: DEBUG cinder.volume.manager [None req-b5b87b37-26b6-4749-94eb-98d4104e9a54 None None] thread info: [<_MainThread(MainThread, started 139182109970560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}